Sep 16 18:14:05.562774 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 18:14:05.562784 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 18:14:05.562791 ip-10-0-142-63 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 18:14:05.562940 ip-10-0-142-63 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 18:14:15.787398 ip-10-0-142-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 18:14:15.787424 ip-10-0-142-63 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 893e47c3b9a440678691599b03757172 --
Sep 16 18:16:05.201203 ip-10-0-142-63 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 18:16:05.553426 ip-10-0-142-63 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:05.553426 ip-10-0-142-63 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 18:16:05.553426 ip-10-0-142-63 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:05.553426 ip-10-0-142-63 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 18:16:05.553426 ip-10-0-142-63 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 18:16:05.555522 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.555436    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 18:16:05.559115 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559100    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.559115 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559115    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559119    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559128    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559133    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559136    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559139    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559142    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559145    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559148    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559152    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559155    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559157    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559160    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559163    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559165    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559168    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559171    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559173    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559176    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559179    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.559186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559186    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559189    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559194    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559198    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559201    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559204    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559207    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559210    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559212    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559216    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559219    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559221    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559224    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559226    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559230    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559232    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559235    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559237    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559239    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.559655 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559242    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559244    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559247    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559249    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559252    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559254    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559257    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559259    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559262    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559264    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559267    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559269    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559272    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559274    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559277    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559280    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559283    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559285    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559289    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559293    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.560168 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559296    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559298    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559303    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559305    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559308    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559311    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559313    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559316    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559319    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559322    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559326    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559329    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559332    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559335    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559337    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559340    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559343    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559345    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559348    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559350    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.560711 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559353    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559355    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559358    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559360    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559363    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559365    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559368    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559371    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559374    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559377    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559379    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559382    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559385    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559387    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559390    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559392    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559395    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559397    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.559400    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.561567 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560126    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560134    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560138    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560141    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560145    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560148    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560151    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560154    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560157    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560160    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560163    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560165    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560168    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560171    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560175    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560180    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560184    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560187    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560190    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.562201 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560192    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560196    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560199    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560202    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560204    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560207    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560210    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560212    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560215    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560218    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560221    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560225    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560229    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560232    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560235    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560238    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560241    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560244    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560247    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560250    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.562673 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560252    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560255    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560257    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560260    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560262    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560266    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560268    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560271    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560273    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560276    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560278    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560281    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560284    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560287    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560289    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560292    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560295    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560298    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560300    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560303    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.563181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560305    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560307    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560310    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560312    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560315    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560317    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560320    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560323    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560325    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560328    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560331    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560333    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560336    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560339    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560342    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560344    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560347    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560350    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560353    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.563662 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560357    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560361    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560364    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560366    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560369    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560372    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560374    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560377    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560379    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560382    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560385    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560387    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560390    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560392    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560395    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560397    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560400    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560402    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560405    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.564162 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560407    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.560410    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561621    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561754    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561763    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561766    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561770    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561775    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561778    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561781    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561784    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561786    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561789    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561792    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561795    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561797    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561800    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561803    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561806    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561810    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.564619 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561814    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561816    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561819    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561823    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561827    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561830    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561833    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561836    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561838    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561842    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561845    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561847    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561850    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561853    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561855    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561861    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561863    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561866    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561870    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561873    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.565129 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561876    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561879    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561881    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561884    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561886    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561904    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561909    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561912    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561915    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561918    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561920    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561923    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561926    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561929    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561931    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561934    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561936    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561942    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561946    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.565657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561949    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561952    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561954    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561957    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561960    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561962    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561965    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561968    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561972    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561974    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561977    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561980    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561983    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561985    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561988    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561991    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561993    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561996    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.561998    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.566134 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562001    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562005    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562008    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562010    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562013    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562016    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562018    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562022    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562024    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562027    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562029    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562032    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562040    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562043    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562046    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562048    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562051    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562054    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562057    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562060    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.566598 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562062    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562066    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562068    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562141    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562174    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562180    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562185    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562189    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562192    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562196    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562200    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562203    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562207    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562210    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562214    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562217    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562221    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562224    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562226    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562229    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562234    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562238    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562241    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562244    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 18:16:05.567143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562247    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562250    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562254    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562256    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562259    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562262    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562265    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562268    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562271    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562275    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562278    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562282    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562285    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562288    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562291    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562294    2565 flags.go:64] FLAG: --enable-server="true"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562297    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562301    2565 flags.go:64] FLAG: --event-burst="100"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562304    2565 flags.go:64] FLAG: --event-qps="50"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562307    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562309    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562312    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562320    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562323    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562326    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 18:16:05.567723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562329    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562332    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562334    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562337    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562340    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562343    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562346    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562349    2565 flags.go:64] FLAG: --feature-gates=""
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562352    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562355    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562359    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562362    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562365    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562368    2565 flags.go:64] FLAG: --help="false"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562370    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562373    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562376    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562379    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562383    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562386    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562389    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562392    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562395    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 18:16:05.568330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562398    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562401    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562404    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562407    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562410    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562412    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562415    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562418    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562421    2565 flags.go:64] FLAG: --lock-file=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562424    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562427    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562429    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562435    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562437    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562440    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562443    2565 flags.go:64] FLAG: --logging-format="text"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562446    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562449    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562452    2565 flags.go:64] FLAG: --manifest-url=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562455    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562459    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562462    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562466    2565 flags.go:64] FLAG: --max-pods="110"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562469    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562472    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 18:16:05.568920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562474    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562477    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562482    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562485    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562488    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562496    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562498    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562501    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562504    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562507    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562512    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562515    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562518    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562521    2565 flags.go:64] FLAG: --port="10250"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562524    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562527    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fbf6c107f4ebde2e"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562530    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562533    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562536    2565 flags.go:64] FLAG: --register-node="true"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562539    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562543    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562546    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562549    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562552    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562556    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 18:16:05.569571 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562559    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562562    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562565    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562568    2565 flags.go:64] FLAG: --runonce="false"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562570    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562573    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562576    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562579    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562582    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562585    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562590    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562593    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562596    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562599    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562602    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562605    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562608    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562611    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562614    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562620    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562622    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562625    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562629    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562631    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562634    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 18:16:05.570225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562637    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562640    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562643    2565 flags.go:64] FLAG: --v="2"
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562647    2565 flags.go:64] FLAG: --version="false"
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562650    2565 flags.go:64] FLAG: --vmodule=""
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562655    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.562658    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562771    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562776    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562780    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562783    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562786    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562789    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562792    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562795    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562798    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562801    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562805    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562808    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562810    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562813    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.570856 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562816    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562818    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562821    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562824    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562826    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562829    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562831    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562834    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562836    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562839    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562842    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562846    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562849    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562852    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562855    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562858    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562860    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562864    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562866    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.571360 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562870    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562873    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562876    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562879    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562881    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562884    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562887    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562904    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562908    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562913    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562916    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562919    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562921    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562924    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562927    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562929    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562932    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562935    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562938    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562940    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.571816 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562943    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562946    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562948    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562951    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562954    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562956    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562959    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562962    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562964    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562967    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562969    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562973    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562977    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562980    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562982    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562985    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562987    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562990    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562992    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562995    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.572326 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.562998    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563002    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563005    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563008    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563010    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563013    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563015    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563018    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563021    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563023    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563026    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563029    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563031    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563034    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563037    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563040    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563042    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563045    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563048    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563050    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.572814 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563053    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563055    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563058    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563061    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563066    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.563070    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.563785    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.570735    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.570750    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.570769    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.570775    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570830    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570834    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570837    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.573320 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570841    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570844    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570846    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570849    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570852    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570854    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570857    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570860    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570863    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570866    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570869    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570872    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570875    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570877    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570880    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570883    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570886    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570901    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570905    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570908    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.573675 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570910    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570913    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570916    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570919    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570922    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570925    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570929    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570931    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570934    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570937    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570939    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570942    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570946    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570950    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570953    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570956    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570959    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570961    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570964    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.574256 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570966    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570969    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570972    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570975    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570977    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570980    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570983    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570985    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570988    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570990    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570993    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570995    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.570998    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571000    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571003    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571005    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571008    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571011    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571014    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571017    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.574749 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571020    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571022    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571025    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571027    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571030    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571032    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571035    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571039    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571041    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571044    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571046    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571049    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571052    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571054    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571057    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571059    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571062    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571064    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571067    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.575327 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571069    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571071    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571074    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571077    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571079    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571082    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571084    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571087    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571089    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571092    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571096    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571098    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571101    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571103    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571107    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571111    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571113    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.575872 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571116    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.571121    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571235    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571241    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571244    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571246    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571249    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571253    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571257    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571260    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571263    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571265    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571268    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571271    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 18:16:05.576335 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571273    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571275    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571278    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571281    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571284    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571286    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571289    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571291    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571294    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571296    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571299    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571301    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571305    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571307    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571310    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571313    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571315    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571317    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571320    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571323    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 18:16:05.576854 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571326    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571328    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571330    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571333    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571335    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571338    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571340    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571343    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571346    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571348    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571351    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571353    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571356    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571359    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571362    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571364    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571367    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571369    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571372    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 18:16:05.577648 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571375    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571377    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571380    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571382    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571384    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571387    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571390    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571393    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571395    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571398    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571400    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571403    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571405    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571408    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571410    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571413    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571415    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571419    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571422    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571425    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 18:16:05.578181 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571428    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571431    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571434    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571436    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571439    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571441    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571444    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571447    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571449    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571452    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571454    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571457    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571459    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571462    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571464    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571467    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571469    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571472    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571474    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571477    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 18:16:05.578657 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571480    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571482    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571485    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571489    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571492    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571495    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571498    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:05.571501    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.571506    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.571603    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.573838    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.574606    2565 server.go:1019] "Starting client certificate rotation"
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.574716    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 18:16:05.579315 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.574765    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 18:16:05.579769 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.576745    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 18:16:05.580798 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.580780    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 18:16:05.591296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.591276    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 16 18:16:05.594302 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.594284    2565 log.go:25] "Validated CRI v1 image API"
Sep 16 18:16:05.595137 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.595121    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 18:16:05.597825 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.597807    2565 fs.go:135] Filesystem UUIDs: map[022b76ad-6e77-485f-bc53-46912013fd50:/dev/nvme0n1p3 06b8822d-b822-4283-b8d7-66482e016eb8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 16 18:16:05.597875 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.597826    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 18:16:05.605383 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.605271    2565 manager.go:216] Machine: {Timestamp:2026-09-16 18:16:05.603817815 +0000 UTC m=+0.296259749 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099769 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2919a16ea97f8b8d202bc18db7360b SystemUUID:ec2919a1-6ea9-7f8b-8d20-2bc18db7360b BootID:893e47c3-b9a4-4067-8691-599b03757172 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d9:57:15:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d9:57:15:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:71:f5:33:7c:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 18:16:05.605383 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.605374    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 18:16:05.605512 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.605461    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 18:16:05.606019 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.606002    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 18:16:05.608343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.608319    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 18:16:05.608489 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.608347    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 18:16:05.609082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.609072    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 18:16:05.609121 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.609085    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 18:16:05.609121 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.609093    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 18:16:05.609943 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.609932    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 18:16:05.610737 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.610728    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 18:16:05.614379 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614368    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 18:16:05.614496 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614486    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 18:16:05.614530 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614515    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 18:16:05.614530 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614525    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 18:16:05.614612 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614542    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 18:16:05.614612 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614552    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 16 18:16:05.614612 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614561    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 18:16:05.614945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614933    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 18:16:05.614989 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.614952    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 18:16:05.617180 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.617165    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 18:16:05.619640 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.619626    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 18:16:05.619700 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.619656    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 18:16:05.621070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621054    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621073    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621081    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621087    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621095    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621109    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621126    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621146    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621153    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 18:16:05.621157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621159    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 18:16:05.621534 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621168    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 18:16:05.621534 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.621173    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 18:16:05.622426 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.622410    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 18:16:05.622484 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.622430    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 18:16:05.622767 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.622719    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 18:16:05.622869 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.622826    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 18:16:05.624335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.624318    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 18:16:05.626227 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.626209    2565 server.go:1268] "Started kubelet"
Sep 16 18:16:05.626370 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.626334    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 18:16:05.626436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.626350    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 18:16:05.626485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.626442    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 18:16:05.627450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.627432    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 18:16:05.627562 ip-10-0-142-63 systemd[1]: Started Kubernetes Kubelet.
Sep 16 18:16:05.631714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.631700    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 18:16:05.632729 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.632706    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 18:16:05.633455 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.633434    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 18:16:05.634032 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.633983    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 18:16:05.634170 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.634137    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:05.634353 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634330    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 18:16:05.634446 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634430    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 18:16:05.634633 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634617    2565 factory.go:55] Registering systemd factory
Sep 16 18:16:05.634686 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634638    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 16 18:16:05.634752 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634741    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 18:16:05.634801 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634753    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 18:16:05.634986 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634971    2565 factory.go:153] Registering CRI-O factory
Sep 16 18:16:05.635040 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.633978    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca06164ef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.626176751 +0000 UTC m=+0.318618683,LastTimestamp:2026-09-16 18:16:05.626176751 +0000 UTC m=+0.318618683,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.635040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.634989    2565 factory.go:223] Registration of the crio container factory successfully
Sep 16 18:16:05.635040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.635021    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 18:16:05.635182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.635058    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 18:16:05.635182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.635077    2565 factory.go:103] Registering Raw factory
Sep 16 18:16:05.635182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.635095    2565 manager.go:1196] Started watching for new ooms in manager
Sep 16 18:16:05.635622 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.635541    2565 manager.go:349] Starting recovery of all containers
Sep 16 18:16:05.637130 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.637094    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 18:16:05.637228 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.637156    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 18:16:05.642832 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.642642    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x6l4n"
Sep 16 18:16:05.646694 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.646676    2565 manager.go:354] Recovery completed
Sep 16 18:16:05.649711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.649692    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x6l4n"
Sep 16 18:16:05.652305 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.652206    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.654040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654025    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.654101 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654053    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.654101 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654069    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.654699 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654685    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 18:16:05.654699 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654693    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.654780 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654702    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 18:16:05.654780 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.654723    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 18:16:05.655407 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.655389    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.655468 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.655419    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.655468 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.655433    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.656145 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.656060    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20a8cea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654039786 +0000 UTC m=+0.346481719,LastTimestamp:2026-09-16 18:16:05.654039786 +0000 UTC m=+0.346481719,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.665092 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.665015    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20adf1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654060829 +0000 UTC m=+0.346502765,LastTimestamp:2026-09-16 18:16:05.654060829 +0000 UTC m=+0.346502765,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.674093 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.674019    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20b1019  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654073369 +0000 UTC m=+0.346515302,LastTimestamp:2026-09-16 18:16:05.654073369 +0000 UTC m=+0.346515302,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.682128 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.682065    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-63.ec2.internal.18d5dfdca20a8cea\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20a8cea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654039786 +0000 UTC m=+0.346481719,LastTimestamp:2026-09-16 18:16:05.655404883 +0000 UTC m=+0.347846817,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.691621 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.691561    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-63.ec2.internal.18d5dfdca20adf1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20adf1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654060829 +0000 UTC m=+0.346502765,LastTimestamp:2026-09-16 18:16:05.655425381 +0000 UTC m=+0.347867315,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.711144 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.701855    2565 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-63.ec2.internal.18d5dfdca20b1019\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-63.ec2.internal.18d5dfdca20b1019  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-63.ec2.internal,UID:ip-10-0-142-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-63.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-63.ec2.internal,},FirstTimestamp:2026-09-16 18:16:05.654073369 +0000 UTC m=+0.346515302,LastTimestamp:2026-09-16 18:16:05.655438455 +0000 UTC m=+0.347880388,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-63.ec2.internal,}"
Sep 16 18:16:05.732469 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.732438    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 18:16:05.733648 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.733626    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 18:16:05.733736 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.733691    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 18:16:05.733736 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.733717    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 18:16:05.733847 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.733761    2565 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 16 18:16:05.734230 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.734208    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:05.742847 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.742821    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 16 18:16:05.793678 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.793657    2565 policy_none.go:49] "None policy: Start"
Sep 16 18:16:05.793778 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.793685    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 18:16:05.793778 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.793698    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 18:16:05.795932 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.795917    2565 policy_none.go:47] "Start"
Sep 16 18:16:05.820025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820010    2565 manager.go:337] "Starting Device Plugin manager"
Sep 16 18:16:05.820106 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.820054    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 18:16:05.820106 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820071    2565 server.go:87] "Starting device plugin registration server"
Sep 16 18:16:05.820414 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820401    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 18:16:05.820482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820416    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 18:16:05.820529 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820498    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 18:16:05.820583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820560    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 18:16:05.820583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.820566    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 18:16:05.821240 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.821220    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 18:16:05.821308 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.821276    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:05.834406 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.834388    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"]
Sep 16 18:16:05.834464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.834454    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.835941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.835924    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.836025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.835954    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.836025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.835969    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.838277 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838264    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.838391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.838435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838407    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.838933 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838920    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.838933 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838927    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.839041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838947    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.839041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838946    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.839041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838966    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.839041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.838957    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.842229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.842211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.842328 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.842243    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.843003 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.842988    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.843076 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.843019    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.843076 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.843033    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.849643 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.849627    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-63.ec2.internal\" not found" node="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.860407 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.860386    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-63.ec2.internal\" not found" node="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.864272 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.864259    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-63.ec2.internal\" not found" node="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.920842 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.920814    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:05.921741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.921724    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:05.921837 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.921753    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:05.921837 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.921768    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:05.921837 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.921802    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.930553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.930538    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.930595 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.930561    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-63.ec2.internal\": node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:05.935757 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.935737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.935802 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:05.935784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:05.957494 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:05.957472    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.036302 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.036278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.036377 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.036315    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.036410 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.036381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.036410 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.036392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6b44a4be57a944743b57866a10f8171-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal\" (UID: \"e6b44a4be57a944743b57866a10f8171\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.036471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.036421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a342c85daba9b5e3dc23662ea15815c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"a342c85daba9b5e3dc23662ea15815c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.058405 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.058355    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.137144 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.137105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a342c85daba9b5e3dc23662ea15815c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"a342c85daba9b5e3dc23662ea15815c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.137220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.137174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a342c85daba9b5e3dc23662ea15815c7-config\") pod \"kube-apiserver-proxy-ip-10-0-142-63.ec2.internal\" (UID: \"a342c85daba9b5e3dc23662ea15815c7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.159253 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.159225    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.162313 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.162300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.167162 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.167031    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:06.259957 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.259911    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.361089 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.361054    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.461959 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.461921    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.548373 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.548346    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:06.562128 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.562103    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.574828 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.574763    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 18:16:06.574891 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.574876    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 18:16:06.662924 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.662870    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.716392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.716361    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 18:16:06.717816 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.717791    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 18:16:06.717890 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.717826    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 18:16:06.717890 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.717839    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeHasSufficientPID"
Sep 16 18:16:06.763004 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.762969    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.795304 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.795251    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 18:11:06 +0000 UTC" deadline="2028-03-18 03:25:31.355693213 +0000 UTC"
Sep 16 18:16:06.795376 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.795305    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13161h9m24.560392172s"
Sep 16 18:16:06.804869 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:06.804826    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda342c85daba9b5e3dc23662ea15815c7.slice/crio-2034515d52cb05c53308a159eac033ea8004b76e7abac1cb9634e2f8c15b713b WatchSource:0}: Error finding container 2034515d52cb05c53308a159eac033ea8004b76e7abac1cb9634e2f8c15b713b: Status 404 returned error can't find the container with id 2034515d52cb05c53308a159eac033ea8004b76e7abac1cb9634e2f8c15b713b
Sep 16 18:16:06.805096 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:06.805079    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b44a4be57a944743b57866a10f8171.slice/crio-c77cb5ba3a629f66f45ecb9acf73c5d483832a4fb8cddbe3a0440fad9ba3d55b WatchSource:0}: Error finding container c77cb5ba3a629f66f45ecb9acf73c5d483832a4fb8cddbe3a0440fad9ba3d55b: Status 404 returned error can't find the container with id c77cb5ba3a629f66f45ecb9acf73c5d483832a4fb8cddbe3a0440fad9ba3d55b
Sep 16 18:16:06.809305 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.809289    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:16:06.841241 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.841178    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:06.864176 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.864149    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:06.960909 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:06.960875    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:06.965292 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:06.965276    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-63.ec2.internal\" not found"
Sep 16 18:16:07.022637 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.022606    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:07.035058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.035030    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:07.047604 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.047582    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 18:16:07.048522 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.048503    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal"
Sep 16 18:16:07.056753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.056736    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 18:16:07.616282 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.616246    2565 apiserver.go:52] "Watching apiserver"
Sep 16 18:16:07.623717 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.623691    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 18:16:07.624703 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.624675    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-772rn","openshift-network-diagnostics/network-check-target-pz8t2","openshift-network-operator/iptables-alerter-hhrm2","openshift-ovn-kubernetes/ovnkube-node-qpz8j","kube-system/global-pull-secret-syncer-fk6hk","kube-system/konnectivity-agent-whnw5","kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8","openshift-cluster-node-tuning-operator/tuned-7gk98","openshift-image-registry/node-ca-hlc67","openshift-multus/multus-7sfpl","openshift-multus/multus-additional-cni-plugins-pk5zd","openshift-dns/node-resolver-vfqgt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal"]
Sep 16 18:16:07.627507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.627480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.629967 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.629944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.632200 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.632177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.633249 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.633228    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 18:16:07.633679 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.633655    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.633772 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.633734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p26w7\""
Sep 16 18:16:07.633994 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.633976    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.634336 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.634169    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 18:16:07.634884 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.634864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.637145 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.636916    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.637240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.637177    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 18:16:07.637746 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.637386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.638078    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vzl68\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.638386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.638636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wt6kq\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.639077    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.639156    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.639513    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.639669    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.639909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.640507 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.640272    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:07.642562 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.642233    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.643345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.643321    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.643692 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.643677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 18:16:07.644782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.644550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.645238 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-kubelet\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-systemd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-etc-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8clf\" (UniqueName: \"kubernetes.io/projected/ced89cd6-52b7-41b9-9a20-454f3f1385de-kube-api-access-x8clf\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-ovn\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/048e8704-f130-4dc6-8eca-efc9f2d6efd7-serviceca\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfdn\" (UniqueName: \"kubernetes.io/projected/048e8704-f130-4dc6-8eca-efc9f2d6efd7-kube-api-access-mcfdn\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnvw\" (UniqueName: \"kubernetes.io/projected/2905bca1-f05e-48f2-9ddc-7647d23697ad-kube-api-access-7qnvw\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-iptables-alerter-script\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.645508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-config\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovn-node-metrics-cert\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wr9z\" (UniqueName: \"kubernetes.io/projected/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-kube-api-access-9wr9z\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-systemd-units\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-node-log\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-bin\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-env-overrides\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645791    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/048e8704-f130-4dc6-8eca-efc9f2d6efd7-host\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645846    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2905bca1-f05e-48f2-9ddc-7647d23697ad-hosts-file\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-slash\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-netns\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.645996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-kubelet-config\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2905bca1-f05e-48f2-9ddc-7647d23697ad-tmp-dir\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.646091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-host-slash\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646124    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-var-lib-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-log-socket\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-netd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-dbus\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-script-lib\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.646826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 18:16:07.647212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.647212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.646981    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2fpw6\""
Sep 16 18:16:07.647212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.647194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 18:16:07.647728 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.647511    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.647728 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.647529    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-42gkn\""
Sep 16 18:16:07.647728 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.647603    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.647728 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.647696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ngx8k\""
Sep 16 18:16:07.650008 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.649863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 18:16:07.650093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.650070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:07.650162 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.650140    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:07.650413 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.650384    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.650413 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.650397    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.650546 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.650503    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zd5ks\""
Sep 16 18:16:07.652233 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.652213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.652330 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.652309    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:07.654987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.654957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.655697 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.655674    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 18:16:07.657474 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.657457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.660475 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.660218    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 18:16:07.660475 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.660237    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 18:16:07.660636 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.660502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2m6ld\""
Sep 16 18:16:07.660920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.660884    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 18:16:07.661145 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.660900    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 18:16:07.661422 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.661401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 18:16:07.662018 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.661897    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 18:16:07.662331 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.662313    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vzcdn\""
Sep 16 18:16:07.694968 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.694947    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68tnc"
Sep 16 18:16:07.707671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.707651    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68tnc"
Sep 16 18:16:07.737149 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.737131    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 18:16:07.738964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.738921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"e6b44a4be57a944743b57866a10f8171","Type":"ContainerStarted","Data":"c77cb5ba3a629f66f45ecb9acf73c5d483832a4fb8cddbe3a0440fad9ba3d55b"}
Sep 16 18:16:07.740245 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.740223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" event={"ID":"a342c85daba9b5e3dc23662ea15815c7","Type":"ContainerStarted","Data":"2034515d52cb05c53308a159eac033ea8004b76e7abac1cb9634e2f8c15b713b"}
Sep 16 18:16:07.747271 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovn-node-metrics-cert\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-systemd\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.747345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-run\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.747345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-sys\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.747345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-system-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wr9z\" (UniqueName: \"kubernetes.io/projected/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-kube-api-access-9wr9z\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-systemd-units\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-bin\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cksrf\" (UniqueName: \"kubernetes.io/projected/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-kube-api-access-cksrf\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-conf-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/048e8704-f130-4dc6-8eca-efc9f2d6efd7-host\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-bin\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747544 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-sys-fs\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cnibin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-multus\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-systemd-units\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747647    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/048e8704-f130-4dc6-8eca-efc9f2d6efd7-host\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2905bca1-f05e-48f2-9ddc-7647d23697ad-hosts-file\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2905bca1-f05e-48f2-9ddc-7647d23697ad-hosts-file\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-kubelet-config\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cni-binary-copy\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.747912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-kubelet-config\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-socket-dir-parent\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.747982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npmtn\" (UniqueName: \"kubernetes.io/projected/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-kube-api-access-npmtn\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-system-cni-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2905bca1-f05e-48f2-9ddc-7647d23697ad-tmp-dir\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-host-slash\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-var-lib-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-log-socket\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-dbus\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-host-slash\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgzjp\" (UniqueName: \"kubernetes.io/projected/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kube-api-access-kgzjp\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-log-socket\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-script-lib\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd41f1ac-1ced-4098-a684-57758bb51da6-konnectivity-ca\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748286    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 18:16:07.748465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-var-lib-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748313    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-kubernetes\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3dd21bfe-b9e2-4341-9418-ce343fffdde5-dbus\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-tuned\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2905bca1-f05e-48f2-9ddc-7647d23697ad-tmp-dir\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-kubelet\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-kubelet\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-etc-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-kubelet\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748615    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-ovn\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-etc-openvswitch\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-lib-modules\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-ovn\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/048e8704-f130-4dc6-8eca-efc9f2d6efd7-serviceca\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfdn\" (UniqueName: \"kubernetes.io/projected/048e8704-f130-4dc6-8eca-efc9f2d6efd7-kube-api-access-mcfdn\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.749074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnvw\" (UniqueName: \"kubernetes.io/projected/2905bca1-f05e-48f2-9ddc-7647d23697ad-kube-api-access-7qnvw\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-iptables-alerter-script\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.748855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-script-lib\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749094    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-registration-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-etc-kubernetes\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/048e8704-f130-4dc6-8eca-efc9f2d6efd7-serviceca\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-node-log\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-node-log\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-env-overrides\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd41f1ac-1ced-4098-a684-57758bb51da6-agent-certs\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-conf\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-host\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.749882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749492    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-cnibin\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-iptables-alerter-script\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-etc-selinux\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-slash\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-netns\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-modprobe-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-daemon-config\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-run-netns\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-netd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-slash\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-env-overrides\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749772    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-host-cni-netd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhgn\" (UniqueName: \"kubernetes.io/projected/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-kube-api-access-zbhgn\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-device-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-bin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.750594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-tmp\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-systemd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.749928    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.749961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ced89cd6-52b7-41b9-9a20-454f3f1385de-run-systemd\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8clf\" (UniqueName: \"kubernetes.io/projected/ced89cd6-52b7-41b9-9a20-454f3f1385de-kube-api-access-x8clf\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.750060    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:08.250044878 +0000 UTC m=+2.942486814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750259    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysconfig\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-multus-certs\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6t9l\" (UniqueName: \"kubernetes.io/projected/5984a95f-6a69-4b33-b278-0a990f5fef74-kube-api-access-g6t9l\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-socket-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-k8s-cni-cncf-io\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-netns\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-hostroot\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.751243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-var-lib-kubelet\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.751859 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.750574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-config\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.751859 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.751125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovnkube-config\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.752735 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.752702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ced89cd6-52b7-41b9-9a20-454f3f1385de-ovn-node-metrics-cert\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.764536 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.764504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wr9z\" (UniqueName: \"kubernetes.io/projected/d63ee7d5-243a-4df6-8557-d5ed250d1f8d-kube-api-access-9wr9z\") pod \"iptables-alerter-hhrm2\" (UID: \"d63ee7d5-243a-4df6-8557-d5ed250d1f8d\") " pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.765380 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.765355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8clf\" (UniqueName: \"kubernetes.io/projected/ced89cd6-52b7-41b9-9a20-454f3f1385de-kube-api-access-x8clf\") pod \"ovnkube-node-qpz8j\" (UID: \"ced89cd6-52b7-41b9-9a20-454f3f1385de\") " pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.765645 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.765624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfdn\" (UniqueName: \"kubernetes.io/projected/048e8704-f130-4dc6-8eca-efc9f2d6efd7-kube-api-access-mcfdn\") pod \"node-ca-hlc67\" (UID: \"048e8704-f130-4dc6-8eca-efc9f2d6efd7\") " pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.766696 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.766676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnvw\" (UniqueName: \"kubernetes.io/projected/2905bca1-f05e-48f2-9ddc-7647d23697ad-kube-api-access-7qnvw\") pod \"node-resolver-vfqgt\" (UID: \"2905bca1-f05e-48f2-9ddc-7647d23697ad\") " pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.851634 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-etc-selinux\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.851760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.851760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-modprobe-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.851760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-daemon-config\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.851760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhgn\" (UniqueName: \"kubernetes.io/projected/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-kube-api-access-zbhgn\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.851760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851751    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-device-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-bin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851811    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-etc-selinux\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-bin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-modprobe-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-tmp\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysconfig\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-multus-certs\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.851995    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6t9l\" (UniqueName: \"kubernetes.io/projected/5984a95f-6a69-4b33-b278-0a990f5fef74-kube-api-access-g6t9l\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-socket-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-k8s-cni-cncf-io\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-netns\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-device-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-hostroot\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-hostroot\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-var-lib-kubelet\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-systemd\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-multus-certs\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852205    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-run\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-var-lib-kubelet\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-run\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-netns\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-daemon-config\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852412    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-run-k8s-cni-cncf-io\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.852560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-socket-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-sys\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-systemd\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-system-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysconfig\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-sys\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852527    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cksrf\" (UniqueName: \"kubernetes.io/projected/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-kube-api-access-cksrf\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-conf-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-system-cni-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-conf-dir\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852585    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-sys-fs\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852624    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-sys-fs\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cnibin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-multus\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cni-binary-copy\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cnibin\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.853231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-socket-dir-parent\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npmtn\" (UniqueName: \"kubernetes.io/projected/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-kube-api-access-npmtn\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-system-cni-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-multus-socket-dir-parent\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgzjp\" (UniqueName: \"kubernetes.io/projected/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kube-api-access-kgzjp\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.852950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-system-cni-dir\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd41f1ac-1ced-4098-a684-57758bb51da6-konnectivity-ca\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-kubernetes\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-tuned\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-kubelet\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.853235    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-cni-binary-copy\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.853304    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:08.353283108 +0000 UTC m=+3.045725046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-lib-modules\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-binary-copy\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-registration-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-kubernetes\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-etc-kubernetes\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-cni-multus\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853431    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd41f1ac-1ced-4098-a684-57758bb51da6-agent-certs\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-conf\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-lib-modules\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-host\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-host-var-lib-kubelet\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-cnibin\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-registration-dir\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5984a95f-6a69-4b33-b278-0a990f5fef74-cnibin\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-d\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-sysctl-conf\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-etc-kubernetes\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.854852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-host\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.855525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.855525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.853885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd41f1ac-1ced-4098-a684-57758bb51da6-konnectivity-ca\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.855525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.854334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5984a95f-6a69-4b33-b278-0a990f5fef74-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.855525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.854359    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-tmp\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.856045 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.856022    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-etc-tuned\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.856323 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.856301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd41f1ac-1ced-4098-a684-57758bb51da6-agent-certs\") pod \"konnectivity-agent-whnw5\" (UID: \"fd41f1ac-1ced-4098-a684-57758bb51da6\") " pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.885926 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.885834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6t9l\" (UniqueName: \"kubernetes.io/projected/5984a95f-6a69-4b33-b278-0a990f5fef74-kube-api-access-g6t9l\") pod \"multus-additional-cni-plugins-pk5zd\" (UID: \"5984a95f-6a69-4b33-b278-0a990f5fef74\") " pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:07.886536 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.886260    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:07.886536 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.886297    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:07.886536 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.886311    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:07.886536 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:07.886372    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:08.386354204 +0000 UTC m=+3.078796151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:07.887612 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.887593    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npmtn\" (UniqueName: \"kubernetes.io/projected/77cc7f92-a01b-4f09-ac5a-24724f1dbb5f-kube-api-access-npmtn\") pod \"multus-7sfpl\" (UID: \"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f\") " pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:07.887825 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.887799    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgzjp\" (UniqueName: \"kubernetes.io/projected/b2c7fbf0-a784-4632-9ee3-15f11abd2d25-kube-api-access-kgzjp\") pod \"aws-ebs-csi-driver-node-42mr8\" (UID: \"b2c7fbf0-a784-4632-9ee3-15f11abd2d25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:07.888582 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.888563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cksrf\" (UniqueName: \"kubernetes.io/projected/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-kube-api-access-cksrf\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:07.889138 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.889116    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhgn\" (UniqueName: \"kubernetes.io/projected/cbe7ef37-2f32-45d4-9ff7-8ec6484017c4-kube-api-access-zbhgn\") pod \"tuned-7gk98\" (UID: \"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4\") " pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.942776 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.942755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hlc67"
Sep 16 18:16:07.950125 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.950104    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vfqgt"
Sep 16 18:16:07.963145 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.963121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hhrm2"
Sep 16 18:16:07.969664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.969641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:07.978568 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.978547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:07.987136 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.987117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7gk98"
Sep 16 18:16:07.994935 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:07.994915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8"
Sep 16 18:16:08.000782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.000766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7sfpl"
Sep 16 18:16:08.009634 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.009617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pk5zd"
Sep 16 18:16:08.255724 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.255629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:08.255902 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.255770    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:08.255902 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.255836    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:09.255815208 +0000 UTC m=+3.948257148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:08.356781 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.356734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:08.356981 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.356867    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:08.356981 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.356943    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:09.356912534 +0000 UTC m=+4.049354470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:08.457481 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.457438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:08.457644 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.457623    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:08.457698 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.457651    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:08.457698 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.457662    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:08.457800 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:08.457718    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:09.457705009 +0000 UTC m=+4.150146931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:08.711036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.710937    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:11:08 +0000 UTC" deadline="2028-03-24 23:08:04.446701942 +0000 UTC"
Sep 16 18:16:08.711036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.710974    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13324h51m55.735733132s"
Sep 16 18:16:08.800083 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.799986    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c7fbf0_a784_4632_9ee3_15f11abd2d25.slice/crio-de92b2ccde0c59d7eed0a8ee25e916a3c4e45c2901972384893f3660b6153127 WatchSource:0}: Error finding container de92b2ccde0c59d7eed0a8ee25e916a3c4e45c2901972384893f3660b6153127: Status 404 returned error can't find the container with id de92b2ccde0c59d7eed0a8ee25e916a3c4e45c2901972384893f3660b6153127
Sep 16 18:16:08.801718 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.801637    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2905bca1_f05e_48f2_9ddc_7647d23697ad.slice/crio-e82cfc34a875bd65dc73bb3328f50c970233e16f2c12d55ff636cce0c2876fc9 WatchSource:0}: Error finding container e82cfc34a875bd65dc73bb3328f50c970233e16f2c12d55ff636cce0c2876fc9: Status 404 returned error can't find the container with id e82cfc34a875bd65dc73bb3328f50c970233e16f2c12d55ff636cce0c2876fc9
Sep 16 18:16:08.805022 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.804992    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cc7f92_a01b_4f09_ac5a_24724f1dbb5f.slice/crio-8a5390aa47eb6b03f284f869fce066c6867dc3e20635acd172f17356a5519d05 WatchSource:0}: Error finding container 8a5390aa47eb6b03f284f869fce066c6867dc3e20635acd172f17356a5519d05: Status 404 returned error can't find the container with id 8a5390aa47eb6b03f284f869fce066c6867dc3e20635acd172f17356a5519d05
Sep 16 18:16:08.806353 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.806116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63ee7d5_243a_4df6_8557_d5ed250d1f8d.slice/crio-7cf4e044fd0d96fdf9a98e8be1e2d6fa0560d74843e2478087b583dafbf59701 WatchSource:0}: Error finding container 7cf4e044fd0d96fdf9a98e8be1e2d6fa0560d74843e2478087b583dafbf59701: Status 404 returned error can't find the container with id 7cf4e044fd0d96fdf9a98e8be1e2d6fa0560d74843e2478087b583dafbf59701
Sep 16 18:16:08.807294 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.807264    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced89cd6_52b7_41b9_9a20_454f3f1385de.slice/crio-89eb974fc4e3e0d9c6b04145d2c1d06aea7c5682dc8d2772f87425abccd8c0db WatchSource:0}: Error finding container 89eb974fc4e3e0d9c6b04145d2c1d06aea7c5682dc8d2772f87425abccd8c0db: Status 404 returned error can't find the container with id 89eb974fc4e3e0d9c6b04145d2c1d06aea7c5682dc8d2772f87425abccd8c0db
Sep 16 18:16:08.808681 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:08.808050    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048e8704_f130_4dc6_8eca_efc9f2d6efd7.slice/crio-7ddbd2cb2bd446ea3cdfb43a6c616afec109a02133b19e7a3f5707b2a8baf998 WatchSource:0}: Error finding container 7ddbd2cb2bd446ea3cdfb43a6c616afec109a02133b19e7a3f5707b2a8baf998: Status 404 returned error can't find the container with id 7ddbd2cb2bd446ea3cdfb43a6c616afec109a02133b19e7a3f5707b2a8baf998
Sep 16 18:16:08.827050 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:08.827029    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 18:16:09.264478 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.264441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:09.264658 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.264639    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:09.264724 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.264712    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:11.26469184 +0000 UTC m=+5.957133768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:09.365498 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.365385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:09.365659 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.365618    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:09.365722 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.365679    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:11.365660203 +0000 UTC m=+6.058102130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:09.467535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.467496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:09.467693 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.467677    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:09.467754 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.467706    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:09.467754 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.467719    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:09.467874 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.467785    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:11.467764674 +0000 UTC m=+6.160206607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:09.711592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.711452    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 18:11:08 +0000 UTC" deadline="2028-05-31 05:35:04.054088676 +0000 UTC"
Sep 16 18:16:09.711592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.711516    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14939h18m54.342577258s"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.734839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.734961    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.735013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.735144    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.734839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:09.735362 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:09.735261    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:09.760981 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.760933    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gk98" event={"ID":"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4","Type":"ContainerStarted","Data":"6f32bec001dd520f28b6fb1665f4f7ebb91992fd8f50ac9b45cac32656a83f59"}
Sep 16 18:16:09.781164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.781083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whnw5" event={"ID":"fd41f1ac-1ced-4098-a684-57758bb51da6","Type":"ContainerStarted","Data":"771158efbab22135ab974366edb59409e7e725d5b91f9d5949d49bb32fbbbd60"}
Sep 16 18:16:09.787122 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.787051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hlc67" event={"ID":"048e8704-f130-4dc6-8eca-efc9f2d6efd7","Type":"ContainerStarted","Data":"7ddbd2cb2bd446ea3cdfb43a6c616afec109a02133b19e7a3f5707b2a8baf998"}
Sep 16 18:16:09.800122 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.800054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhrm2" event={"ID":"d63ee7d5-243a-4df6-8557-d5ed250d1f8d","Type":"ContainerStarted","Data":"7cf4e044fd0d96fdf9a98e8be1e2d6fa0560d74843e2478087b583dafbf59701"}
Sep 16 18:16:09.820991 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.820964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7sfpl" event={"ID":"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f","Type":"ContainerStarted","Data":"8a5390aa47eb6b03f284f869fce066c6867dc3e20635acd172f17356a5519d05"}
Sep 16 18:16:09.827591 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.827512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfqgt" event={"ID":"2905bca1-f05e-48f2-9ddc-7647d23697ad","Type":"ContainerStarted","Data":"e82cfc34a875bd65dc73bb3328f50c970233e16f2c12d55ff636cce0c2876fc9"}
Sep 16 18:16:09.833096 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.833071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8" event={"ID":"b2c7fbf0-a784-4632-9ee3-15f11abd2d25","Type":"ContainerStarted","Data":"de92b2ccde0c59d7eed0a8ee25e916a3c4e45c2901972384893f3660b6153127"}
Sep 16 18:16:09.853955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.853925    2565 generic.go:356] "Generic (PLEG): container finished" podID="e6b44a4be57a944743b57866a10f8171" containerID="81694b19955851d93aab2d52ba5df77a370e149e4f457e73a9405a952a4063db" exitCode=0
Sep 16 18:16:09.854801 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.854779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"e6b44a4be57a944743b57866a10f8171","Type":"ContainerDied","Data":"81694b19955851d93aab2d52ba5df77a370e149e4f457e73a9405a952a4063db"}
Sep 16 18:16:09.861511 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.861443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerStarted","Data":"92a68091cacf30d658e084fbf968d1e1910a1a42568336fc7953d5a3b50e30b4"}
Sep 16 18:16:09.883720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.883596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"89eb974fc4e3e0d9c6b04145d2c1d06aea7c5682dc8d2772f87425abccd8c0db"}
Sep 16 18:16:09.900506 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:09.899871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" event={"ID":"a342c85daba9b5e3dc23662ea15815c7","Type":"ContainerStarted","Data":"710954f1b10305a03dc6d334025856ff9e5c2072f248e255e1ecde19d7b812a4"}
Sep 16 18:16:10.931268 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:10.930999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" event={"ID":"e6b44a4be57a944743b57866a10f8171","Type":"ContainerStarted","Data":"69e0e75a46ec97c84e809378d9e6e25ebb5650908e8a981a316246ffc0338cb6"}
Sep 16 18:16:10.950695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:10.949757    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-63.ec2.internal" podStartSLOduration=3.949732313 podStartE2EDuration="3.949732313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:09.91888587 +0000 UTC m=+4.611327813" watchObservedRunningTime="2026-09-16 18:16:10.949732313 +0000 UTC m=+5.642174260"
Sep 16 18:16:11.284095 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.283334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:11.284095 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.283578    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:11.284095 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.283647    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:15.28362811 +0000 UTC m=+9.976070039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:11.384405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.383769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:11.384405 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.383967    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:11.384405 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.384034    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:15.384014483 +0000 UTC m=+10.076456409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:11.485379 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.484677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:11.485379 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.484895    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:11.485379 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.484916    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:11.485379 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.484930    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:11.485379 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.485017    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:15.484989916 +0000 UTC m=+10.177431839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:11.742218 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.742127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:11.742382 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.742309    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:11.745855 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.743324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:11.745855 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.743486    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:11.745855 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:11.743585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:11.745855 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:11.743726    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:13.734362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:13.734326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:13.734362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:13.734363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:13.734982 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:13.734326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:13.734982 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:13.734475    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:13.734982 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:13.734598    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:13.734982 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:13.734666    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:15.317462 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.317147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:15.318024 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.317336    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:15.318024 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.317604    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.317582397 +0000 UTC m=+18.010024338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:15.418463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.418422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:15.418664 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.418606    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:15.418726 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.418670    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.418650605 +0000 UTC m=+18.111092527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:15.519555 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.518868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:15.519555 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.519113    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:15.519555 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.519136    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:15.519555 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.519152    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:15.519555 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.519214    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:23.51919509 +0000 UTC m=+18.211637017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:15.735360 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.735270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:15.735520 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.735395    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:15.735520 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.735411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:15.735610 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.735526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:15.735610 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:15.735582    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:15.735690 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:15.735669    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:17.735256 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:17.734908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:17.735256 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:17.734934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:17.735256 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:17.734934    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:17.735256 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:17.735035    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:17.735256 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:17.735156    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:17.735878 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:17.735270    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:19.734010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:19.733985    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:19.734348 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:19.733992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:19.734348 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:19.734108    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:19.734348 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:19.733990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:19.734348 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:19.734197    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:19.734533 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:19.734392    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:21.734509 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:21.734467    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:21.735059 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:21.734607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:21.735059 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:21.734616    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:21.735059 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:21.734641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:21.735059 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:21.734726    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:21.735059 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:21.734822    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:23.381163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.381127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:23.381684 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.381263    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:23.381684 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.381325    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:39.381311418 +0000 UTC m=+34.073753337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:23.481741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.481694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:23.481954 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.481822    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:23.481954 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.481917    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:16:39.481881952 +0000 UTC m=+34.174323876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:23.582627 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.582593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:23.582821 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.582749    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:23.582821 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.582770    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:23.582821 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.582782    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:23.582992 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.582841    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:39.582824238 +0000 UTC m=+34.275266159 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:23.734711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.734628    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:23.734711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.734673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:23.734958 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:23.734644    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:23.734958 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.734762    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:23.734958 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.734831    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:23.734958 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:23.734923    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:25.735414 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:25.735378    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:25.735861 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:25.735454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:25.735861 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:25.735467    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:25.735861 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:25.735591    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:25.735861 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:25.735614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:25.735861 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:25.735684    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:27.734875 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.734689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:27.735804 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.734716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:27.735804 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:27.734976    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:27.735804 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.734768    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:27.735804 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:27.735024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:27.735804 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:27.735127    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:27.973538 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.973502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7gk98" event={"ID":"cbe7ef37-2f32-45d4-9ff7-8ec6484017c4","Type":"ContainerStarted","Data":"f6ec81e73e47e8d7308008c8d60336217f7816b4437094c2abb9f59d76666906"}
Sep 16 18:16:27.974953 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.974923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-whnw5" event={"ID":"fd41f1ac-1ced-4098-a684-57758bb51da6","Type":"ContainerStarted","Data":"f2a51b26c42f30bcc6f9181b36d1d94c983247a15bb8d7d1387a54cccfe122e8"}
Sep 16 18:16:27.976273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.976251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hlc67" event={"ID":"048e8704-f130-4dc6-8eca-efc9f2d6efd7","Type":"ContainerStarted","Data":"7efab42d016a4c8283061d11196c18273d2ba96f00ff86801eb0da76e95f586d"}
Sep 16 18:16:27.977615 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.977593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7sfpl" event={"ID":"77cc7f92-a01b-4f09-ac5a-24724f1dbb5f","Type":"ContainerStarted","Data":"50f60af2401aa138cc6d90a58a14a56a4982b71ff29e61fc5eeffd80878daccd"}
Sep 16 18:16:27.978939 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.978918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vfqgt" event={"ID":"2905bca1-f05e-48f2-9ddc-7647d23697ad","Type":"ContainerStarted","Data":"cb2971ecd83bc6a5d9df030a4449d014afdb9e54358e146876bb6f8298b0387c"}
Sep 16 18:16:27.980318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.980297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8" event={"ID":"b2c7fbf0-a784-4632-9ee3-15f11abd2d25","Type":"ContainerStarted","Data":"9831352d00d80c7854a8258a95957f9bcf439cf78529009244b5a0322ad204a4"}
Sep 16 18:16:27.981951 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.981930    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="e9550ac3e959631d5a91d4e7eed94c7b10c6754e7267a9c70d7450fdef0915b4" exitCode=0
Sep 16 18:16:27.982070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.982013    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"e9550ac3e959631d5a91d4e7eed94c7b10c6754e7267a9c70d7450fdef0915b4"}
Sep 16 18:16:27.985539 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"b09dff456f858873365a2486ccad9a21b06366ded83fb6d8a882eb0440892b86"}
Sep 16 18:16:27.985600 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"956fb5c5a62ff312d13ae665a32eae7a3fc420d7502b81095c0b9a31095907be"}
Sep 16 18:16:27.985643 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"904a9d80b5c7499a0331ca4e79792278f7cb7d7aa1c517048b513bd076aa130d"}
Sep 16 18:16:27.985643 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"c4773ebf2b9a2c8e62cfd7bc296b03510621f9989f281b45c7b4505e84ecddfb"}
Sep 16 18:16:27.985711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985667    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"eb29be5a4aa8c40e7a9bed61c5eed004f1c31ec69a80ecc1f1e89566a662d8af"}
Sep 16 18:16:27.985711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.985693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"3c316dcc9c62f723702460da13346b6d8c41d29055599879b9787c3ab1ea3851"}
Sep 16 18:16:27.995191 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:27.995156    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-63.ec2.internal" podStartSLOduration=20.99514618 podStartE2EDuration="20.99514618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:10.950625959 +0000 UTC m=+5.643067907" watchObservedRunningTime="2026-09-16 18:16:27.99514618 +0000 UTC m=+22.687588121"
Sep 16 18:16:28.034686 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.034637    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7gk98" podStartSLOduration=3.9030797699999997 podStartE2EDuration="22.034622464s" totalImagesPullingTime="18.131542694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:27.994958058 +0000 UTC m=+22.687400001" watchObservedRunningTime="2026-09-16 18:16:28.034622464 +0000 UTC m=+22.727064439"
Sep 16 18:16:28.075489 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.075448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-whnw5" podStartSLOduration=11.219513687 podStartE2EDuration="22.075434156s" totalImagesPullingTime="10.855920469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:28.053876722 +0000 UTC m=+22.746318664" watchObservedRunningTime="2026-09-16 18:16:28.075434156 +0000 UTC m=+22.767876098"
Sep 16 18:16:28.075817 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.075780    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hlc67" podStartSLOduration=3.942776861 podStartE2EDuration="22.075764162s" totalImagesPullingTime="18.132987301s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:28.075602465 +0000 UTC m=+22.768044408" watchObservedRunningTime="2026-09-16 18:16:28.075764162 +0000 UTC m=+22.768206104"
Sep 16 18:16:28.094525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.094485    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vfqgt" podStartSLOduration=3.955166638 podStartE2EDuration="22.094471395s" totalImagesPullingTime="18.139304757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:28.094302721 +0000 UTC m=+22.786744662" watchObservedRunningTime="2026-09-16 18:16:28.094471395 +0000 UTC m=+22.786913338"
Sep 16 18:16:28.117936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.117720    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7sfpl" podStartSLOduration=3.900743963 podStartE2EDuration="22.117701479s" totalImagesPullingTime="18.216957516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:28.117430591 +0000 UTC m=+22.809872539" watchObservedRunningTime="2026-09-16 18:16:28.117701479 +0000 UTC m=+22.810143422"
Sep 16 18:16:28.633831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.633684    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 18:16:28.831880 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.831735    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T18:16:28.633710261Z","UUID":"b75c39d4-0f5a-4b3c-9557-9d70e0cc35da","Handler":null,"Name":"","Endpoint":""}
Sep 16 18:16:28.833301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.833272    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 18:16:28.833301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.833307    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 18:16:28.990335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.990296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8" event={"ID":"b2c7fbf0-a784-4632-9ee3-15f11abd2d25","Type":"ContainerStarted","Data":"132cb70faf26ed2ccc0ebb5ce7e8b749a5db62a5bd6e6bb62d4efd2a3781dba6"}
Sep 16 18:16:28.991841 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:28.991816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hhrm2" event={"ID":"d63ee7d5-243a-4df6-8557-d5ed250d1f8d","Type":"ContainerStarted","Data":"f532ab50076279d69573e279c162349d4683f7d391d97074036ef7bffbdb4430"}
Sep 16 18:16:29.009651 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:29.009601    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hhrm2" podStartSLOduration=4.874479523 podStartE2EDuration="23.00958221s" totalImagesPullingTime="18.135102687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:29.009230002 +0000 UTC m=+23.701671943" watchObservedRunningTime="2026-09-16 18:16:29.00958221 +0000 UTC m=+23.702024153"
Sep 16 18:16:29.734617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:29.734588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:29.734731 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:29.734621    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:29.734731 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:29.734706    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:29.734847 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:29.734747    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:29.734847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:29.734814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:29.734970 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:29.734951    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:29.998478 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:29.998442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"e9f973fa416f791439590964c41f07f7216e2b25b95f629dab296131b5de0a63"}
Sep 16 18:16:30.000325 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:30.000293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8" event={"ID":"b2c7fbf0-a784-4632-9ee3-15f11abd2d25","Type":"ContainerStarted","Data":"e2fb7091eda3528e4276649777c85167dfb4ded6e551e73aba84cfc1be8fd283"}
Sep 16 18:16:30.608493 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:30.608460    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:30.609216 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:30.609189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:30.639364 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:30.639306    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-42mr8" podStartSLOduration=4.284343286 podStartE2EDuration="24.639285782s" totalImagesPullingTime="20.354942496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:30.03799572 +0000 UTC m=+24.730437661" watchObservedRunningTime="2026-09-16 18:16:30.639285782 +0000 UTC m=+25.331727725"
Sep 16 18:16:31.002652 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:31.002522    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:31.003110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:31.002850    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-whnw5"
Sep 16 18:16:31.734171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:31.734138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:31.734361 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:31.734181    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:31.734361 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:31.734138    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:31.734361 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:31.734259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:31.734361 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:31.734310    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:31.734558 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:31.734391    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:33.008215 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.008032    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="b67ea1b122a87fc4e4e0fc41c76e8ff35e470019bb3002e4876aa9ac5874ae83" exitCode=0
Sep 16 18:16:33.009080 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.008121    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"b67ea1b122a87fc4e4e0fc41c76e8ff35e470019bb3002e4876aa9ac5874ae83"}
Sep 16 18:16:33.012460 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.012434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" event={"ID":"ced89cd6-52b7-41b9-9a20-454f3f1385de","Type":"ContainerStarted","Data":"363f5ef2b3b2b2b4b92d03c589294ef411946c5b61bd8548506308798ae24ecf"}
Sep 16 18:16:33.078286 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.078248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j" podStartSLOduration=8.928748528 podStartE2EDuration="27.078235214s" totalImagesPullingTime="18.149486686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:33.077522849 +0000 UTC m=+27.769964791" watchObservedRunningTime="2026-09-16 18:16:33.078235214 +0000 UTC m=+27.770677156"
Sep 16 18:16:33.734859 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.734830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:33.735107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.734879    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:33.735107 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:33.735031    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:33.735107 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:33.735094    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:33.735270 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:33.735121    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:33.735270 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:33.735255    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:34.017947 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.017707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:34.018330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.018225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:34.018330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.018282    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:34.033057 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.033031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:34.033189 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.033149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:16:34.118392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.118362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pz8t2"]
Sep 16 18:16:34.118547 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.118464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:34.118547 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:34.118538    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:34.121213 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.121172    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk6hk"]
Sep 16 18:16:34.121322 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.121268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:34.121380 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:34.121362    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:34.121711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.121692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-772rn"]
Sep 16 18:16:34.121805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:34.121792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:34.121918 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:34.121885    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:35.020139 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:35.020108    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="3eb1e2d9ffffd6f94c6635504ad95a969da33ac1255de80748fe3f59b71b8bd6" exitCode=0
Sep 16 18:16:35.020535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:35.020199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"3eb1e2d9ffffd6f94c6635504ad95a969da33ac1255de80748fe3f59b71b8bd6"}
Sep 16 18:16:35.735592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:35.735569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:35.735675 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:35.735652    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:35.735751 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:35.735731    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:35.735850 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:35.735832    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:35.735886 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:35.735877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:35.736039 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:35.736022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:36.024407 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:36.024369    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="fc230fcf9f02528505e1b35751c4b07ab9b092c6d5c2ceab7ffa53dd89104410" exitCode=0
Sep 16 18:16:36.024798 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:36.024457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"fc230fcf9f02528505e1b35751c4b07ab9b092c6d5c2ceab7ffa53dd89104410"}
Sep 16 18:16:37.734825 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:37.734792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:37.735240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:37.734881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:37.735240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:37.734931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:37.735240 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:37.734925    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:37.735240 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:37.735024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:37.735240 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:37.735113    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:39.402463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.402244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:39.403044 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.402395    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:39.403044 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.402604    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret podName:3dd21bfe-b9e2-4341-9418-ce343fffdde5 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:11.402579532 +0000 UTC m=+66.095021466 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret") pod "global-pull-secret-syncer-fk6hk" (UID: "3dd21bfe-b9e2-4341-9418-ce343fffdde5") : object "kube-system"/"original-pull-secret" not registered
Sep 16 18:16:39.502812 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.502769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:39.503013 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.502964    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:39.503083 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.503041    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs podName:c007a65a-2e75-405d-a5e4-091bcc4ca1ce nodeName:}" failed. No retries permitted until 2026-09-16 18:17:11.503020958 +0000 UTC m=+66.195462898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs") pod "network-metrics-daemon-772rn" (UID: "c007a65a-2e75-405d-a5e4-091bcc4ca1ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 18:16:39.603874 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.603832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:39.604040 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.604014    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 18:16:39.604158 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.604040    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 18:16:39.604158 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.604066    2565 projected.go:196] Error preparing data for projected volume kube-api-access-6zrhh for pod openshift-network-diagnostics/network-check-target-pz8t2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:39.604158 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.604144    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh podName:1270c44f-2918-4daa-9644-39b113ea2858 nodeName:}" failed. No retries permitted until 2026-09-16 18:17:11.604119116 +0000 UTC m=+66.296561039 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zrhh" (UniqueName: "kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh") pod "network-check-target-pz8t2" (UID: "1270c44f-2918-4daa-9644-39b113ea2858") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 18:16:39.734685 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.734614    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:39.734685 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.734627    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:39.734877 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:39.734756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:39.734877 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.734761    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fk6hk" podUID="3dd21bfe-b9e2-4341-9418-ce343fffdde5"
Sep 16 18:16:39.735921 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.735241    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pz8t2" podUID="1270c44f-2918-4daa-9644-39b113ea2858"
Sep 16 18:16:39.735921 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:39.735507    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-772rn" podUID="c007a65a-2e75-405d-a5e4-091bcc4ca1ce"
Sep 16 18:16:40.135404 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.135377    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-63.ec2.internal" event="NodeReady"
Sep 16 18:16:40.135560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.135480    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 18:16:40.202407 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.202384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:16:40.219108 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.219086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.222011 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.221993    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6vc6x"]
Sep 16 18:16:40.226668 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.226649    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 18:16:40.226668 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.226661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 18:16:40.226805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.226650    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 18:16:40.227010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.226994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8b29l\""
Sep 16 18:16:40.241319 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.241304    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-99hj9"]
Sep 16 18:16:40.241429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.241416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.251852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.251836    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.252132 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.252114    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 18:16:40.252233 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.252218    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 18:16:40.252362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.252348    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pfff7\""
Sep 16 18:16:40.252427 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.252383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 18:16:40.262023 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.262006    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 18:16:40.262098 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.262047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 18:16:40.262098 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.262083    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 18:16:40.262227 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.262212    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-76n2b\""
Sep 16 18:16:40.279808 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.279788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vc6x"]
Sep 16 18:16:40.280329 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.280313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99hj9"]
Sep 16 18:16:40.282543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.282519    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:16:40.309089 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309111    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wzk\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309275 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309275 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309246    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.309335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.309298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410368 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410368 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410331    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410368 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wzk\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbdf0fb-9360-4de9-8885-bad6c1db8981-config-volume\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bbdf0fb-9360-4de9-8885-bad6c1db8981-tmp-dir\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmfj\" (UniqueName: \"kubernetes.io/projected/da24c96b-7b67-4bbf-8512-2b5b0ae95881-kube-api-access-qdmfj\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da24c96b-7b67-4bbf-8512-2b5b0ae95881-cert\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcnr\" (UniqueName: \"kubernetes.io/projected/1bbdf0fb-9360-4de9-8885-bad6c1db8981-kube-api-access-pwcnr\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.410854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.410818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.411438 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.410928    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:16:40.411438 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.410943    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbddcc57d-gdnbt: secret "image-registry-tls" not found
Sep 16 18:16:40.411438 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.411014    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls podName:c9357a49-56d3-473b-9a0d-ad603f3d4a67 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:40.910993204 +0000 UTC m=+35.603435136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls") pod "image-registry-7fbddcc57d-gdnbt" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67") : secret "image-registry-tls" not found
Sep 16 18:16:40.411438 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.411325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.411617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.411485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.414528 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.414505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.414611 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.414505    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.427009 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.426990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.427088 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.427059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wzk\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.512107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbdf0fb-9360-4de9-8885-bad6c1db8981-config-volume\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.512229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512116    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.512229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bbdf0fb-9360-4de9-8885-bad6c1db8981-tmp-dir\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.512229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmfj\" (UniqueName: \"kubernetes.io/projected/da24c96b-7b67-4bbf-8512-2b5b0ae95881-kube-api-access-qdmfj\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.512331 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.512241    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:40.512331 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da24c96b-7b67-4bbf-8512-2b5b0ae95881-cert\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.512331 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.512305    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls podName:1bbdf0fb-9360-4de9-8885-bad6c1db8981 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:41.012285029 +0000 UTC m=+35.704726970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls") pod "dns-default-6vc6x" (UID: "1bbdf0fb-9360-4de9-8885-bad6c1db8981") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:40.512451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512345    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcnr\" (UniqueName: \"kubernetes.io/projected/1bbdf0fb-9360-4de9-8885-bad6c1db8981-kube-api-access-pwcnr\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.512451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bbdf0fb-9360-4de9-8885-bad6c1db8981-tmp-dir\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.512730 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.512714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bbdf0fb-9360-4de9-8885-bad6c1db8981-config-volume\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.514592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.514572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da24c96b-7b67-4bbf-8512-2b5b0ae95881-cert\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.539877 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.539853    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmfj\" (UniqueName: \"kubernetes.io/projected/da24c96b-7b67-4bbf-8512-2b5b0ae95881-kube-api-access-qdmfj\") pod \"ingress-canary-99hj9\" (UID: \"da24c96b-7b67-4bbf-8512-2b5b0ae95881\") " pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.545317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.545298    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcnr\" (UniqueName: \"kubernetes.io/projected/1bbdf0fb-9360-4de9-8885-bad6c1db8981-kube-api-access-pwcnr\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:40.559352 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.559328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-99hj9"
Sep 16 18:16:40.656800 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.656774    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"]
Sep 16 18:16:40.689223 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.689169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"]
Sep 16 18:16:40.689297 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.689273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.695238 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.695191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:40.695238 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.695203    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 16 18:16:40.695405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.695243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 16 18:16:40.695540 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.695520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jgj8w\""
Sep 16 18:16:40.696308 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.696292    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 16 18:16:40.814964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.814940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9bl\" (UniqueName: \"kubernetes.io/projected/05b07898-2e61-4221-bd8b-49f488f62833-kube-api-access-4l9bl\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.815081 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.815026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05b07898-2e61-4221-bd8b-49f488f62833-serving-cert\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.815081 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.815046    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05b07898-2e61-4221-bd8b-49f488f62833-config\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.882789 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.882629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-99hj9"]
Sep 16 18:16:40.885572 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:40.885547    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda24c96b_7b67_4bbf_8512_2b5b0ae95881.slice/crio-9d8654f5a2de4857810af2173a0f6fc1c698677631bc46a41fad2eb8d93ab057 WatchSource:0}: Error finding container 9d8654f5a2de4857810af2173a0f6fc1c698677631bc46a41fad2eb8d93ab057: Status 404 returned error can't find the container with id 9d8654f5a2de4857810af2173a0f6fc1c698677631bc46a41fad2eb8d93ab057
Sep 16 18:16:40.916372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.916342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9bl\" (UniqueName: \"kubernetes.io/projected/05b07898-2e61-4221-bd8b-49f488f62833-kube-api-access-4l9bl\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.916472 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.916384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:40.916532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.916469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05b07898-2e61-4221-bd8b-49f488f62833-serving-cert\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.916532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.916493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05b07898-2e61-4221-bd8b-49f488f62833-config\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.916626 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.916551    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:16:40.916626 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.916572    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbddcc57d-gdnbt: secret "image-registry-tls" not found
Sep 16 18:16:40.916715 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:40.916644    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls podName:c9357a49-56d3-473b-9a0d-ad603f3d4a67 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:41.91662361 +0000 UTC m=+36.609065537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls") pod "image-registry-7fbddcc57d-gdnbt" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67") : secret "image-registry-tls" not found
Sep 16 18:16:40.933659 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.933630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05b07898-2e61-4221-bd8b-49f488f62833-serving-cert\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.933749 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.933708    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05b07898-2e61-4221-bd8b-49f488f62833-config\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.933796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.933762    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9bl\" (UniqueName: \"kubernetes.io/projected/05b07898-2e61-4221-bd8b-49f488f62833-kube-api-access-4l9bl\") pod \"service-ca-operator-cf7c776b7-5wpkb\" (UID: \"05b07898-2e61-4221-bd8b-49f488f62833\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:40.998499 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:40.998480    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"
Sep 16 18:16:41.017821 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.017796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:41.017981 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.017963    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:41.018041 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.018020    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls podName:1bbdf0fb-9360-4de9-8885-bad6c1db8981 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:42.018005722 +0000 UTC m=+36.710447652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls") pod "dns-default-6vc6x" (UID: "1bbdf0fb-9360-4de9-8885-bad6c1db8981") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:41.023070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.023048    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"]
Sep 16 18:16:41.040493 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.040466    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="3a98c2c6b59ef917e52e3ed787cc4d0f180be68653085077e3884e23b89079d3" exitCode=0
Sep 16 18:16:41.041644 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.041620    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"3a98c2c6b59ef917e52e3ed787cc4d0f180be68653085077e3884e23b89079d3"}
Sep 16 18:16:41.041766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.041710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.041966 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.041939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99hj9" event={"ID":"da24c96b-7b67-4bbf-8512-2b5b0ae95881","Type":"ContainerStarted","Data":"9d8654f5a2de4857810af2173a0f6fc1c698677631bc46a41fad2eb8d93ab057"}
Sep 16 18:16:41.044619 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.044598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"]
Sep 16 18:16:41.045106 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.045089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fmd9s\""
Sep 16 18:16:41.045448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.045429    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 16 18:16:41.045819 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.045803    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 16 18:16:41.219677 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.219643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.219781 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.219698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acc0d164-61fa-443b-9e4e-2d16953d834b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.307452 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.307299    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb"]
Sep 16 18:16:41.310456 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:41.310432    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b07898_2e61_4221_bd8b_49f488f62833.slice/crio-3c6749d9bf16f8214ae22750cb4b0614020bc419e0da9fe8601069ce2a766be5 WatchSource:0}: Error finding container 3c6749d9bf16f8214ae22750cb4b0614020bc419e0da9fe8601069ce2a766be5: Status 404 returned error can't find the container with id 3c6749d9bf16f8214ae22750cb4b0614020bc419e0da9fe8601069ce2a766be5
Sep 16 18:16:41.320379 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.320357    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.320487 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.320414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acc0d164-61fa-443b-9e4e-2d16953d834b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.320549 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.320526    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:41.320608 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.320595    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:41.820574969 +0000 UTC m=+36.513016888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:41.321139 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.321119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/acc0d164-61fa-443b-9e4e-2d16953d834b-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.734219 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.734184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:16:41.735010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.734184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:16:41.735010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.734192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:16:41.737515 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.737495    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 18:16:41.737678 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.737657    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 18:16:41.737784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.737715    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gs7dj\""
Sep 16 18:16:41.737946 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.737786    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 18:16:41.738028 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.737946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 18:16:41.738090 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.738039    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xdwg2\""
Sep 16 18:16:41.825441 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.825355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:41.825701 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.825529    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:41.825701 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.825605    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:42.825582314 +0000 UTC m=+37.518024250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:41.926134 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:41.926097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:41.926333 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.926287    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:16:41.926333 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.926309    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbddcc57d-gdnbt: secret "image-registry-tls" not found
Sep 16 18:16:41.926450 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:41.926371    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls podName:c9357a49-56d3-473b-9a0d-ad603f3d4a67 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:43.926351177 +0000 UTC m=+38.618793115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls") pod "image-registry-7fbddcc57d-gdnbt" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67") : secret "image-registry-tls" not found
Sep 16 18:16:42.027258 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:42.027175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:42.027425 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:42.027320    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:42.027425 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:42.027408    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls podName:1bbdf0fb-9360-4de9-8885-bad6c1db8981 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:44.027380397 +0000 UTC m=+38.719822330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls") pod "dns-default-6vc6x" (UID: "1bbdf0fb-9360-4de9-8885-bad6c1db8981") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:42.051964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:42.051924    2565 generic.go:356] "Generic (PLEG): container finished" podID="5984a95f-6a69-4b33-b278-0a990f5fef74" containerID="42318ba2328954a265c15e937f2c645dc736f7ce9816827467d7f7b24ae6a41b" exitCode=0
Sep 16 18:16:42.052109 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:42.052015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerDied","Data":"42318ba2328954a265c15e937f2c645dc736f7ce9816827467d7f7b24ae6a41b"}
Sep 16 18:16:42.053605 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:42.053571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb" event={"ID":"05b07898-2e61-4221-bd8b-49f488f62833","Type":"ContainerStarted","Data":"3c6749d9bf16f8214ae22750cb4b0614020bc419e0da9fe8601069ce2a766be5"}
Sep 16 18:16:42.835254 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:42.835217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:42.835740 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:42.835394    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:42.835740 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:42.835477    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:44.835453971 +0000 UTC m=+39.527895910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:43.060139 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:43.060105    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" event={"ID":"5984a95f-6a69-4b33-b278-0a990f5fef74","Type":"ContainerStarted","Data":"f63b1e8033d0b350b4652b5b78882839039ecabd998ce848634bfe0e01f425b0"}
Sep 16 18:16:43.107808 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:43.107553    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pk5zd" podStartSLOduration=8.47215816 podStartE2EDuration="37.107533219s" totalImagesPullingTime="28.635375059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:43.107089227 +0000 UTC m=+37.799531171" watchObservedRunningTime="2026-09-16 18:16:43.107533219 +0000 UTC m=+37.799975163"
Sep 16 18:16:43.946599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:43.946085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:43.946599 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:43.946259    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:16:43.946599 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:43.946414    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbddcc57d-gdnbt: secret "image-registry-tls" not found
Sep 16 18:16:43.946599 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:43.946482    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls podName:c9357a49-56d3-473b-9a0d-ad603f3d4a67 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:47.946461915 +0000 UTC m=+42.638903852 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls") pod "image-registry-7fbddcc57d-gdnbt" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67") : secret "image-registry-tls" not found
Sep 16 18:16:44.048341 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.047596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:44.048341 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:44.047847    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:44.048341 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:44.047937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls podName:1bbdf0fb-9360-4de9-8885-bad6c1db8981 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:48.0479172 +0000 UTC m=+42.740359133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls") pod "dns-default-6vc6x" (UID: "1bbdf0fb-9360-4de9-8885-bad6c1db8981") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:44.064530 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.064487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-99hj9" event={"ID":"da24c96b-7b67-4bbf-8512-2b5b0ae95881","Type":"ContainerStarted","Data":"6ccf0489ad966427ecdff74878be12df0446956c0330333ab98cb08f2ee8ae64"}
Sep 16 18:16:44.066122 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.066095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb" event={"ID":"05b07898-2e61-4221-bd8b-49f488f62833","Type":"ContainerStarted","Data":"4b33fcbfa6725be451e0e34b082b8dab50b8762cdb376453dca402a4891861f6"}
Sep 16 18:16:44.117389 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.117332    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-99hj9" podStartSLOduration=1.254854562 podStartE2EDuration="4.117311869s" totalImagesPullingTime="2.862457307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:44.090368103 +0000 UTC m=+38.782810057" watchObservedRunningTime="2026-09-16 18:16:44.117311869 +0000 UTC m=+38.809753814"
Sep 16 18:16:44.117553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.117529    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb" podStartSLOduration=1.6740286229999999 podStartE2EDuration="4.117520051s" totalImagesPullingTime="2.443491428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:44.117217123 +0000 UTC m=+38.809659065" watchObservedRunningTime="2026-09-16 18:16:44.117520051 +0000 UTC m=+38.809961992"
Sep 16 18:16:44.853588 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:44.853560    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:44.853741 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:44.853669    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:44.853741 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:44.853719    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:48.853705731 +0000 UTC m=+43.546147651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:46.248227 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.248192    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mp2c"]
Sep 16 18:16:46.273705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.273678    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mp2c"]
Sep 16 18:16:46.273857 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.273791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.278562 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.278543    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 18:16:46.278842 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.278828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 18:16:46.279094 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.279076    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 18:16:46.279425 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.279408    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 18:16:46.279598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.279585    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-glhq5\""
Sep 16 18:16:46.465479 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.465441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.465479 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.465482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ada9ea00-a678-441e-be1d-efed67d92ffb-data-volume\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.465701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.465602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.465701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.465667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmhss\" (UniqueName: \"kubernetes.io/projected/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-api-access-bmhss\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.465701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.465701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ada9ea00-a678-441e-be1d-efed67d92ffb-crio-socket\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.478755 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.478726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"]
Sep 16 18:16:46.500202 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.500147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"
Sep 16 18:16:46.503167 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.503137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-c5r6m\""
Sep 16 18:16:46.503722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.503703    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 16 18:16:46.503838 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.503819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 16 18:16:46.510096 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.510074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"]
Sep 16 18:16:46.566564 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt6h5\" (UniqueName: \"kubernetes.io/projected/2ab1d218-8574-4496-9b83-6ce975e1d991-kube-api-access-mt6h5\") pod \"migrator-8b4d697c5-sghbd\" (UID: \"2ab1d218-8574-4496-9b83-6ce975e1d991\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"
Sep 16 18:16:46.566564 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmhss\" (UniqueName: \"kubernetes.io/projected/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-api-access-bmhss\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.566796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ada9ea00-a678-441e-be1d-efed67d92ffb-crio-socket\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.566796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.566796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ada9ea00-a678-441e-be1d-efed67d92ffb-data-volume\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.566796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.566796 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:46.566780    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:46.567061 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:46.566831    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:16:46.567061 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.566840    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ada9ea00-a678-441e-be1d-efed67d92ffb-crio-socket\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.567061 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:46.566858    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:47.066837627 +0000 UTC m=+41.759279569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:46.567061 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:46.566920    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:47.066883156 +0000 UTC m=+41.759325091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : configmap "kube-rbac-proxy" not found
Sep 16 18:16:46.567236 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.567125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ada9ea00-a678-441e-be1d-efed67d92ffb-data-volume\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.590262 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.590224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmhss\" (UniqueName: \"kubernetes.io/projected/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-api-access-bmhss\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:46.667240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.667206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt6h5\" (UniqueName: \"kubernetes.io/projected/2ab1d218-8574-4496-9b83-6ce975e1d991-kube-api-access-mt6h5\") pod \"migrator-8b4d697c5-sghbd\" (UID: \"2ab1d218-8574-4496-9b83-6ce975e1d991\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"
Sep 16 18:16:46.679515 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.679484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt6h5\" (UniqueName: \"kubernetes.io/projected/2ab1d218-8574-4496-9b83-6ce975e1d991-kube-api-access-mt6h5\") pod \"migrator-8b4d697c5-sghbd\" (UID: \"2ab1d218-8574-4496-9b83-6ce975e1d991\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"
Sep 16 18:16:46.808338 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:46.808303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"
Sep 16 18:16:47.070404 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:47.070311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:47.070546 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:47.070428    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:47.070546 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.070440    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:16:47.070546 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.070516    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:48.070496974 +0000 UTC m=+42.762938896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : configmap "kube-rbac-proxy" not found
Sep 16 18:16:47.070703 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.070546    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:47.070703 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.070598    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:48.070585488 +0000 UTC m=+42.763027428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:47.085873 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:47.085849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd"]
Sep 16 18:16:47.088800 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:47.088777    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab1d218_8574_4496_9b83_6ce975e1d991.slice/crio-2eceb7510d359a97b40b8d7d26b5cc06567f857e981b75bf76a4b4652daa7f74 WatchSource:0}: Error finding container 2eceb7510d359a97b40b8d7d26b5cc06567f857e981b75bf76a4b4652daa7f74: Status 404 returned error can't find the container with id 2eceb7510d359a97b40b8d7d26b5cc06567f857e981b75bf76a4b4652daa7f74
Sep 16 18:16:47.529592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:47.529521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfqgt_2905bca1-f05e-48f2-9ddc-7647d23697ad/dns-node-resolver/0.log"
Sep 16 18:16:47.976806 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:47.976769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:47.976958 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.976940    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 16 18:16:47.977023 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.976959    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fbddcc57d-gdnbt: secret "image-registry-tls" not found
Sep 16 18:16:47.977070 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:47.977032    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls podName:c9357a49-56d3-473b-9a0d-ad603f3d4a67 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:55.977010984 +0000 UTC m=+50.669452918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls") pod "image-registry-7fbddcc57d-gdnbt" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67") : secret "image-registry-tls" not found
Sep 16 18:16:48.077173 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.077136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:48.077338 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077310    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:48.077408 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.077328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:48.077408 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077387    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:50.077366453 +0000 UTC m=+44.769808392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:48.077518 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.077412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:48.077518 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077427    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:16:48.077518 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077490    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:50.077474909 +0000 UTC m=+44.769916835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : configmap "kube-rbac-proxy" not found
Sep 16 18:16:48.077661 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077533    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 18:16:48.077661 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.077569    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls podName:1bbdf0fb-9360-4de9-8885-bad6c1db8981 nodeName:}" failed. No retries permitted until 2026-09-16 18:16:56.0775577 +0000 UTC m=+50.769999626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls") pod "dns-default-6vc6x" (UID: "1bbdf0fb-9360-4de9-8885-bad6c1db8981") : secret "dns-default-metrics-tls" not found
Sep 16 18:16:48.077772 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.077688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd" event={"ID":"2ab1d218-8574-4496-9b83-6ce975e1d991","Type":"ContainerStarted","Data":"2eceb7510d359a97b40b8d7d26b5cc06567f857e981b75bf76a4b4652daa7f74"}
Sep 16 18:16:48.084073 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.084043    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f7hx5"]
Sep 16 18:16:48.097309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.097281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.102303 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.102285    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 18:16:48.102536 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.102520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-52pdk\""
Sep 16 18:16:48.103273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.103255    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 18:16:48.103792 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.103735    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 18:16:48.105450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.105431    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 18:16:48.120260 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.120237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f7hx5"]
Sep 16 18:16:48.178245 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.178220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7phkl\" (UniqueName: \"kubernetes.io/projected/f0bd7ded-642a-4124-82fd-48b99f059c1f-kube-api-access-7phkl\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.178362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.178281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-cabundle\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.178405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.178385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-key\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.279691 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.279638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-cabundle\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.279782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.279704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-key\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.279782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.279759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7phkl\" (UniqueName: \"kubernetes.io/projected/f0bd7ded-642a-4124-82fd-48b99f059c1f-kube-api-access-7phkl\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.280387 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.280368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-cabundle\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.281936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.281917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f0bd7ded-642a-4124-82fd-48b99f059c1f-signing-key\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.291183 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.291161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7phkl\" (UniqueName: \"kubernetes.io/projected/f0bd7ded-642a-4124-82fd-48b99f059c1f-kube-api-access-7phkl\") pod \"service-ca-568869fdc5-f7hx5\" (UID: \"f0bd7ded-642a-4124-82fd-48b99f059c1f\") " pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.407839 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.407817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f7hx5"
Sep 16 18:16:48.728780 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.728759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hlc67_048e8704-f130-4dc6-8eca-efc9f2d6efd7/node-ca/0.log"
Sep 16 18:16:48.864255 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.864202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f7hx5"]
Sep 16 18:16:48.866452 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:48.866429    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bd7ded_642a_4124_82fd_48b99f059c1f.slice/crio-40aeeb47c8551a44abb2e9aeec4b444fd8e9a97292e976a6afc870bbc0bfee3e WatchSource:0}: Error finding container 40aeeb47c8551a44abb2e9aeec4b444fd8e9a97292e976a6afc870bbc0bfee3e: Status 404 returned error can't find the container with id 40aeeb47c8551a44abb2e9aeec4b444fd8e9a97292e976a6afc870bbc0bfee3e
Sep 16 18:16:48.885395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:48.885376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:48.885493 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.885482    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:48.885532 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:48.885526    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:16:56.885512583 +0000 UTC m=+51.577954503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:49.082211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.082177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd" event={"ID":"2ab1d218-8574-4496-9b83-6ce975e1d991","Type":"ContainerStarted","Data":"4115032d636fac6a3f1e720850c85748b1b65fdd688ec0ac0b84c4c8f31e3d28"}
Sep 16 18:16:49.082351 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.082240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd" event={"ID":"2ab1d218-8574-4496-9b83-6ce975e1d991","Type":"ContainerStarted","Data":"3f4b18c70f9fb0fe0d65d77b5fc7af696da0a9b4101f5f8b865fefc5c2205f58"}
Sep 16 18:16:49.083663 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.083641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f7hx5" event={"ID":"f0bd7ded-642a-4124-82fd-48b99f059c1f","Type":"ContainerStarted","Data":"65ab566886f2e1c4b783d52137053ec8c48991652d75f19548917956e667688f"}
Sep 16 18:16:49.083749 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.083679    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f7hx5" event={"ID":"f0bd7ded-642a-4124-82fd-48b99f059c1f","Type":"ContainerStarted","Data":"40aeeb47c8551a44abb2e9aeec4b444fd8e9a97292e976a6afc870bbc0bfee3e"}
Sep 16 18:16:49.117705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.117634    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-sghbd" podStartSLOduration=1.627176223 podStartE2EDuration="3.117621737s" totalImagesPullingTime="1.490445514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:49.114573971 +0000 UTC m=+43.807015912" watchObservedRunningTime="2026-09-16 18:16:49.117621737 +0000 UTC m=+43.810063682"
Sep 16 18:16:49.133810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.133769    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-f7hx5" podStartSLOduration=1.13375846 podStartE2EDuration="1.13375846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:49.132500856 +0000 UTC m=+43.824942811" watchObservedRunningTime="2026-09-16 18:16:49.13375846 +0000 UTC m=+43.826200402"
Sep 16 18:16:49.333237 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:49.333213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99hj9_da24c96b-7b67-4bbf-8512-2b5b0ae95881/serve-healthcheck-canary/0.log"
Sep 16 18:16:50.094558 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:50.094532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:50.095030 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:50.094637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:50.095030 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:50.094662    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:50.095030 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:50.094704    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 18:16:50.095030 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:50.094723    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:54.094705597 +0000 UTC m=+48.787147520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:50.095030 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:50.094766    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:16:54.094755747 +0000 UTC m=+48.787197673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : configmap "kube-rbac-proxy" not found
Sep 16 18:16:54.125119 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:54.125077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:54.125687 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:54.125203    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:54.125687 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:54.125348    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:54.125687 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:54.125409    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls podName:ada9ea00-a678-441e-be1d-efed67d92ffb nodeName:}" failed. No retries permitted until 2026-09-16 18:17:02.125391589 +0000 UTC m=+56.817833529 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mp2c" (UID: "ada9ea00-a678-441e-be1d-efed67d92ffb") : secret "insights-runtime-extractor-tls" not found
Sep 16 18:16:54.125833 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:54.125692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ada9ea00-a678-441e-be1d-efed67d92ffb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:16:56.039818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.039773    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:56.042482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.042457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"image-registry-7fbddcc57d-gdnbt\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") " pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:56.128358 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.128319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:56.140783 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.140742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:56.146016 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.145993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bbdf0fb-9360-4de9-8885-bad6c1db8981-metrics-tls\") pod \"dns-default-6vc6x\" (UID: \"1bbdf0fb-9360-4de9-8885-bad6c1db8981\") " pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:56.148373 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.148357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:56.419404 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.419311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:16:56.425186 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:56.425156    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9357a49_56d3_473b_9a0d_ad603f3d4a67.slice/crio-b65ee2c61693f200e1e9362d4ea5d38aef8ea329ca730dce12bf0ca4012be0f5 WatchSource:0}: Error finding container b65ee2c61693f200e1e9362d4ea5d38aef8ea329ca730dce12bf0ca4012be0f5: Status 404 returned error can't find the container with id b65ee2c61693f200e1e9362d4ea5d38aef8ea329ca730dce12bf0ca4012be0f5
Sep 16 18:16:56.443378 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.443347    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vc6x"]
Sep 16 18:16:56.446641 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:16:56.446617    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbdf0fb_9360_4de9_8885_bad6c1db8981.slice/crio-642b5a132ae232f2e920ea12b646806855a5e47d18dca9df27386677593e3761 WatchSource:0}: Error finding container 642b5a132ae232f2e920ea12b646806855a5e47d18dca9df27386677593e3761: Status 404 returned error can't find the container with id 642b5a132ae232f2e920ea12b646806855a5e47d18dca9df27386677593e3761
Sep 16 18:16:56.947100 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:56.947054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:16:56.947550 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:56.947508    2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 16 18:16:56.947695 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:16:56.947605    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert podName:acc0d164-61fa-443b-9e4e-2d16953d834b nodeName:}" failed. No retries permitted until 2026-09-16 18:17:12.94757912 +0000 UTC m=+67.640021054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-5ztrg" (UID: "acc0d164-61fa-443b-9e4e-2d16953d834b") : secret "networking-console-plugin-cert" not found
Sep 16 18:16:57.106463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:57.106418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" event={"ID":"c9357a49-56d3-473b-9a0d-ad603f3d4a67","Type":"ContainerStarted","Data":"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"}
Sep 16 18:16:57.107027 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:57.106602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:16:57.107027 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:57.106649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" event={"ID":"c9357a49-56d3-473b-9a0d-ad603f3d4a67","Type":"ContainerStarted","Data":"b65ee2c61693f200e1e9362d4ea5d38aef8ea329ca730dce12bf0ca4012be0f5"}
Sep 16 18:16:57.107908 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:57.107871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vc6x" event={"ID":"1bbdf0fb-9360-4de9-8885-bad6c1db8981","Type":"ContainerStarted","Data":"642b5a132ae232f2e920ea12b646806855a5e47d18dca9df27386677593e3761"}
Sep 16 18:16:57.135979 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:57.135697    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" podStartSLOduration=18.13567919 podStartE2EDuration="18.13567919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:57.13551716 +0000 UTC m=+51.827959106" watchObservedRunningTime="2026-09-16 18:16:57.13567919 +0000 UTC m=+51.828121129"
Sep 16 18:16:58.113324 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:58.113280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vc6x" event={"ID":"1bbdf0fb-9360-4de9-8885-bad6c1db8981","Type":"ContainerStarted","Data":"c1ffe423dd701328e3d1eb3bcf5e8697b5c511ed134521937e4e8ce127c1b467"}
Sep 16 18:16:59.122978 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:59.122934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vc6x" event={"ID":"1bbdf0fb-9360-4de9-8885-bad6c1db8981","Type":"ContainerStarted","Data":"aca7c6190f1c702527fda5a58f83565d18346859c9ff5dbf9344352a66bd0b1d"}
Sep 16 18:16:59.123448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:59.123031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:16:59.142406 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:16:59.142363    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6vc6x" podStartSLOduration=17.579464956 podStartE2EDuration="19.142349186s" totalImagesPullingTime="1.56288423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:16:59.1420624 +0000 UTC m=+53.834504342" watchObservedRunningTime="2026-09-16 18:16:59.142349186 +0000 UTC m=+53.834791127"
Sep 16 18:17:02.194684 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:02.194640    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:17:02.197029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:02.197006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ada9ea00-a678-441e-be1d-efed67d92ffb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mp2c\" (UID: \"ada9ea00-a678-441e-be1d-efed67d92ffb\") " pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:17:02.483261 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:02.483159    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mp2c"
Sep 16 18:17:02.758969 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:02.758869    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mp2c"]
Sep 16 18:17:02.762702 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:02.762668    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada9ea00_a678_441e_be1d_efed67d92ffb.slice/crio-19b61e313865835f4525b3fa25a0b0b8b5eb711de49a5116201764b5310dcbd6 WatchSource:0}: Error finding container 19b61e313865835f4525b3fa25a0b0b8b5eb711de49a5116201764b5310dcbd6: Status 404 returned error can't find the container with id 19b61e313865835f4525b3fa25a0b0b8b5eb711de49a5116201764b5310dcbd6
Sep 16 18:17:03.138737 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:03.138701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mp2c" event={"ID":"ada9ea00-a678-441e-be1d-efed67d92ffb","Type":"ContainerStarted","Data":"f79d3d850c9cd6cbe5011cfe043dc643cad621309dad788d7a27f7062db8048d"}
Sep 16 18:17:03.138931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:03.138762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mp2c" event={"ID":"ada9ea00-a678-441e-be1d-efed67d92ffb","Type":"ContainerStarted","Data":"19b61e313865835f4525b3fa25a0b0b8b5eb711de49a5116201764b5310dcbd6"}
Sep 16 18:17:04.146944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:04.146918    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mp2c" event={"ID":"ada9ea00-a678-441e-be1d-efed67d92ffb","Type":"ContainerStarted","Data":"2a6bea20e60697b17a7c52657dec75303a6b00dd46100b93be31c0f9f0005792"}
Sep 16 18:17:06.035152 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:06.035128    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qpz8j"
Sep 16 18:17:06.154552 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:06.154524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mp2c" event={"ID":"ada9ea00-a678-441e-be1d-efed67d92ffb","Type":"ContainerStarted","Data":"4d96607a7991700149bd7274c0b1ff2d5a01adf934047566693e67a3f0616c46"}
Sep 16 18:17:06.176532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:06.176486    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mp2c" podStartSLOduration=17.580660832 podStartE2EDuration="20.176472068s" totalImagesPullingTime="2.595811236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:06.175368583 +0000 UTC m=+60.867810504" watchObservedRunningTime="2026-09-16 18:17:06.176472068 +0000 UTC m=+60.868914009"
Sep 16 18:17:09.128603 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:09.128567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6vc6x"
Sep 16 18:17:11.458733 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.458698    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:17:11.463601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.463583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 18:17:11.471816 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.471800    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3dd21bfe-b9e2-4341-9418-ce343fffdde5-original-pull-secret\") pod \"global-pull-secret-syncer-fk6hk\" (UID: \"3dd21bfe-b9e2-4341-9418-ce343fffdde5\") " pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:17:11.559637 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.559611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:17:11.561995 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.561977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 18:17:11.572749 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.572724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c007a65a-2e75-405d-a5e4-091bcc4ca1ce-metrics-certs\") pod \"network-metrics-daemon-772rn\" (UID: \"c007a65a-2e75-405d-a5e4-091bcc4ca1ce\") " pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:17:11.660355 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.660328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:17:11.663022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.663005    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 18:17:11.673641 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.673622    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 18:17:11.683947 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.683925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zrhh\" (UniqueName: \"kubernetes.io/projected/1270c44f-2918-4daa-9644-39b113ea2858-kube-api-access-6zrhh\") pod \"network-check-target-pz8t2\" (UID: \"1270c44f-2918-4daa-9644-39b113ea2858\") " pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:17:11.747111 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.747056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fk6hk"
Sep 16 18:17:11.756610 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.756590    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gs7dj\""
Sep 16 18:17:11.761238 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.761222    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xdwg2\""
Sep 16 18:17:11.764820 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.764800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:17:11.769518 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:11.769500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-772rn"
Sep 16 18:17:12.023296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.023238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fk6hk"]
Sep 16 18:17:12.025654 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:12.025628    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd21bfe_b9e2_4341_9418_ce343fffdde5.slice/crio-11f9eee89ea224ee392c6867981e282765be54ee4ab0f345b1d0ab91984d9f19 WatchSource:0}: Error finding container 11f9eee89ea224ee392c6867981e282765be54ee4ab0f345b1d0ab91984d9f19: Status 404 returned error can't find the container with id 11f9eee89ea224ee392c6867981e282765be54ee4ab0f345b1d0ab91984d9f19
Sep 16 18:17:12.048172 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.048153    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-772rn"]
Sep 16 18:17:12.049834 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:12.049811    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc007a65a_2e75_405d_a5e4_091bcc4ca1ce.slice/crio-b53fbdc9c388cecb19d4971f6a201448dafc0c0fdb0c0e7fa5ecbac346b67e36 WatchSource:0}: Error finding container b53fbdc9c388cecb19d4971f6a201448dafc0c0fdb0c0e7fa5ecbac346b67e36: Status 404 returned error can't find the container with id b53fbdc9c388cecb19d4971f6a201448dafc0c0fdb0c0e7fa5ecbac346b67e36
Sep 16 18:17:12.050092 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.050075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pz8t2"]
Sep 16 18:17:12.052679 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:12.052660    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1270c44f_2918_4daa_9644_39b113ea2858.slice/crio-14b807fc11f9d2b94edef2b8ed30a59d4c89262987648c7ee99cbbe1e7c52d9c WatchSource:0}: Error finding container 14b807fc11f9d2b94edef2b8ed30a59d4c89262987648c7ee99cbbe1e7c52d9c: Status 404 returned error can't find the container with id 14b807fc11f9d2b94edef2b8ed30a59d4c89262987648c7ee99cbbe1e7c52d9c
Sep 16 18:17:12.175628 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.175594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772rn" event={"ID":"c007a65a-2e75-405d-a5e4-091bcc4ca1ce","Type":"ContainerStarted","Data":"b53fbdc9c388cecb19d4971f6a201448dafc0c0fdb0c0e7fa5ecbac346b67e36"}
Sep 16 18:17:12.176761 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.176735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pz8t2" event={"ID":"1270c44f-2918-4daa-9644-39b113ea2858","Type":"ContainerStarted","Data":"14b807fc11f9d2b94edef2b8ed30a59d4c89262987648c7ee99cbbe1e7c52d9c"}
Sep 16 18:17:12.177784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.177765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk6hk" event={"ID":"3dd21bfe-b9e2-4341-9418-ce343fffdde5","Type":"ContainerStarted","Data":"11f9eee89ea224ee392c6867981e282765be54ee4ab0f345b1d0ab91984d9f19"}
Sep 16 18:17:12.693814 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.693762    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"]
Sep 16 18:17:12.696096 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.696070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.701470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.701398    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"]
Sep 16 18:17:12.703507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.703434    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 18:17:12.703848 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.703809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.703848 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.703843    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 16 18:17:12.704598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.704562    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 18:17:12.704856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.704835    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 18:17:12.708467 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.708446    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 18:17:12.708664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.708647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 18:17:12.708938 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.708920    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 18:17:12.709160 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.709143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 18:17:12.738538 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.738517    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"]
Sep 16 18:17:12.751694 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.751672    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"]
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769558    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/94a8b965-b9e1-4926-ace9-aec263315951-kube-api-access-727pw\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/94a8b965-b9e1-4926-ace9-aec263315951-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a8b965-b9e1-4926-ace9-aec263315951-tmp\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8173f3-856e-46e3-bd26-7531b296c66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.770042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.769956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzb64\" (UniqueName: \"kubernetes.io/projected/ac8173f3-856e-46e3-bd26-7531b296c66e-kube-api-access-gzb64\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.808060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.808037    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:17:12.814813 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.814709    2565 patch_prober.go:28] interesting pod/image-registry-7fbddcc57d-gdnbt container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 16 18:17:12.814813 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.814756    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:17:12.870714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a8b965-b9e1-4926-ace9-aec263315951-tmp\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.870867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8173f3-856e-46e3-bd26-7531b296c66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.870867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzb64\" (UniqueName: \"kubernetes.io/projected/ac8173f3-856e-46e3-bd26-7531b296c66e-kube-api-access-gzb64\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.870867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.870867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870839    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.871129 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.871129 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/94a8b965-b9e1-4926-ace9-aec263315951-kube-api-access-727pw\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.871129 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.871129 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.870973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/94a8b965-b9e1-4926-ace9-aec263315951-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.871333 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.871147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94a8b965-b9e1-4926-ace9-aec263315951-tmp\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.872457 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.872397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8173f3-856e-46e3-bd26-7531b296c66e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.874410 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.874385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.875054 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.874781    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/94a8b965-b9e1-4926-ace9-aec263315951-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.875054 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.875018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-hub\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.875270 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.875228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.875595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.875561    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8173f3-856e-46e3-bd26-7531b296c66e-ca\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.879270 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.879244    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7875c945d7-nfrvz"]
Sep 16 18:17:12.882363 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.882345    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.891253 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.891214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzb64\" (UniqueName: \"kubernetes.io/projected/ac8173f3-856e-46e3-bd26-7531b296c66e-kube-api-access-gzb64\") pod \"cluster-proxy-proxy-agent-b97f9786d-8282s\" (UID: \"ac8173f3-856e-46e3-bd26-7531b296c66e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:12.892245 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.891959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-727pw\" (UniqueName: \"kubernetes.io/projected/94a8b965-b9e1-4926-ace9-aec263315951-kube-api-access-727pw\") pod \"klusterlet-addon-workmgr-7d5bb57f8f-d58nw\" (UID: \"94a8b965-b9e1-4926-ace9-aec263315951\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:12.900591 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.899876    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875c945d7-nfrvz"]
Sep 16 18:17:12.972350 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-tls\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972350 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgc8x\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-kube-api-access-vgc8x\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-ca-trust-extracted\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-bound-sa-token\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-image-registry-private-configuration\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972520    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-certificates\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972726 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-installation-pull-secrets\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.972726 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972633    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:17:12.972726 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.972659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-trusted-ca\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:12.975999 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:12.975952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/acc0d164-61fa-443b-9e4e-2d16953d834b-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-5ztrg\" (UID: \"acc0d164-61fa-443b-9e4e-2d16953d834b\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:17:13.010824 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.010642    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:13.033286 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.033265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"
Sep 16 18:17:13.073338 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-bound-sa-token\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-image-registry-private-configuration\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-certificates\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073421    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-installation-pull-secrets\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-trusted-ca\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-tls\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgc8x\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-kube-api-access-vgc8x\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.073599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-ca-trust-extracted\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.074006 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.073969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-ca-trust-extracted\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.074358 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.074317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-certificates\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.074567 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.074520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-trusted-ca\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.076882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.076859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-image-registry-private-configuration\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.077223 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.077202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-installation-pull-secrets\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.078553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.078534    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-registry-tls\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.093178 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.093146    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-bound-sa-token\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.093690 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.093577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgc8x\" (UniqueName: \"kubernetes.io/projected/329fa8ee-f426-4de5-8b9a-c1dd3f1a7271-kube-api-access-vgc8x\") pod \"image-registry-7875c945d7-nfrvz\" (UID: \"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271\") " pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.157161 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.156925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fmd9s\""
Sep 16 18:17:13.163619 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.163372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"
Sep 16 18:17:13.211285 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.211065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:13.533023 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.532942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s"]
Sep 16 18:17:13.535469 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:13.535443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac8173f3_856e_46e3_bd26_7531b296c66e.slice/crio-9ca1128a3b4a05a4fe4135da11e804e83b1084b56466c13842bc88e1fefe29c2 WatchSource:0}: Error finding container 9ca1128a3b4a05a4fe4135da11e804e83b1084b56466c13842bc88e1fefe29c2: Status 404 returned error can't find the container with id 9ca1128a3b4a05a4fe4135da11e804e83b1084b56466c13842bc88e1fefe29c2
Sep 16 18:17:13.564157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.564090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7875c945d7-nfrvz"]
Sep 16 18:17:13.566070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.566018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg"]
Sep 16 18:17:13.568093 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:13.567758    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329fa8ee_f426_4de5_8b9a_c1dd3f1a7271.slice/crio-132a414c4dcbcce8ff0fc8933220e8fd8196ad3385e73ae2fff995b7689df9bf WatchSource:0}: Error finding container 132a414c4dcbcce8ff0fc8933220e8fd8196ad3385e73ae2fff995b7689df9bf: Status 404 returned error can't find the container with id 132a414c4dcbcce8ff0fc8933220e8fd8196ad3385e73ae2fff995b7689df9bf
Sep 16 18:17:13.573578 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:13.573548    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc0d164_61fa_443b_9e4e_2d16953d834b.slice/crio-4f678958e95f6ae4c77d8ac3871355d13b7dfdf8cbf5ffb8f519732ee3351d86 WatchSource:0}: Error finding container 4f678958e95f6ae4c77d8ac3871355d13b7dfdf8cbf5ffb8f519732ee3351d86: Status 404 returned error can't find the container with id 4f678958e95f6ae4c77d8ac3871355d13b7dfdf8cbf5ffb8f519732ee3351d86
Sep 16 18:17:13.582245 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:13.582222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"]
Sep 16 18:17:13.585012 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:13.584979    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a8b965_b9e1_4926_ace9_aec263315951.slice/crio-34b72057e327718a446cc63b9f8b8287f8bb38a00036c181f70676400f925f47 WatchSource:0}: Error finding container 34b72057e327718a446cc63b9f8b8287f8bb38a00036c181f70676400f925f47: Status 404 returned error can't find the container with id 34b72057e327718a446cc63b9f8b8287f8bb38a00036c181f70676400f925f47
Sep 16 18:17:14.194990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.194446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772rn" event={"ID":"c007a65a-2e75-405d-a5e4-091bcc4ca1ce","Type":"ContainerStarted","Data":"173df8f2dcadfbb18b896b4b2add15b8ab231505ce058507576d4fcbbc40823c"}
Sep 16 18:17:14.194990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.194515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-772rn" event={"ID":"c007a65a-2e75-405d-a5e4-091bcc4ca1ce","Type":"ContainerStarted","Data":"a64033b5883487f09a6e2cf6376825ecd28de2ca5078db53edf85cf4cb7ad375"}
Sep 16 18:17:14.197772 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.197704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg" event={"ID":"acc0d164-61fa-443b-9e4e-2d16953d834b","Type":"ContainerStarted","Data":"4f678958e95f6ae4c77d8ac3871355d13b7dfdf8cbf5ffb8f519732ee3351d86"}
Sep 16 18:17:14.199583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.199555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw" event={"ID":"94a8b965-b9e1-4926-ace9-aec263315951","Type":"ContainerStarted","Data":"34b72057e327718a446cc63b9f8b8287f8bb38a00036c181f70676400f925f47"}
Sep 16 18:17:14.202107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.202067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s" event={"ID":"ac8173f3-856e-46e3-bd26-7531b296c66e","Type":"ContainerStarted","Data":"9ca1128a3b4a05a4fe4135da11e804e83b1084b56466c13842bc88e1fefe29c2"}
Sep 16 18:17:14.205367 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.204778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz" event={"ID":"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271","Type":"ContainerStarted","Data":"d906002187a12f8b82855ac14fcfac26871979e4c661ee7504026e658962de7c"}
Sep 16 18:17:14.205367 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.204820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz" event={"ID":"329fa8ee-f426-4de5-8b9a-c1dd3f1a7271","Type":"ContainerStarted","Data":"132a414c4dcbcce8ff0fc8933220e8fd8196ad3385e73ae2fff995b7689df9bf"}
Sep 16 18:17:14.205620 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.205573    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:14.293822 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.293675    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-772rn" podStartSLOduration=67.082435986 podStartE2EDuration="1m8.293655374s" totalImagesPullingTime="1.211219388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:14.240885672 +0000 UTC m=+68.933327621" watchObservedRunningTime="2026-09-16 18:17:14.293655374 +0000 UTC m=+68.986097299"
Sep 16 18:17:14.295937 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:14.295097    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz" podStartSLOduration=2.295082967 podStartE2EDuration="2.295082967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:14.293157308 +0000 UTC m=+68.985599254" watchObservedRunningTime="2026-09-16 18:17:14.295082967 +0000 UTC m=+68.987524914"
Sep 16 18:17:22.242756 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.242655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pz8t2" event={"ID":"1270c44f-2918-4daa-9644-39b113ea2858","Type":"ContainerStarted","Data":"6c74de0a00e7bbcdade556d77c83e2fc8747286de34e7fbae18e8caa479fec7c"}
Sep 16 18:17:22.243271 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.242787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:17:22.244720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.244689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg" event={"ID":"acc0d164-61fa-443b-9e4e-2d16953d834b","Type":"ContainerStarted","Data":"06a318e99097754a6a4ffc20934c482ab40b98cff863e09e04fd026d407b9eab"}
Sep 16 18:17:22.246349 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.246319    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw" event={"ID":"94a8b965-b9e1-4926-ace9-aec263315951","Type":"ContainerStarted","Data":"465d7cec3840867f0faa26b06d1b09acff49d7d5b746ad7879d8c715056d0f62"}
Sep 16 18:17:22.246505 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.246443    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:22.248720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.248694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw"
Sep 16 18:17:22.249035 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.249005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s" event={"ID":"ac8173f3-856e-46e3-bd26-7531b296c66e","Type":"ContainerStarted","Data":"141b50eee7fe906c2d42abf7828612c2f4e550951054807e950b9d21a84528a5"}
Sep 16 18:17:22.249175 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.249048    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s" event={"ID":"ac8173f3-856e-46e3-bd26-7531b296c66e","Type":"ContainerStarted","Data":"93efa5ff5ab70eb3bbf6588f70d463fc4fb37af526362aa828398edc32087565"}
Sep 16 18:17:22.249175 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.249067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s" event={"ID":"ac8173f3-856e-46e3-bd26-7531b296c66e","Type":"ContainerStarted","Data":"f77b2713f9912fd82a5d4cb5ab3fd87bb429211fbc3a94e852af55c3f38a65a1"}
Sep 16 18:17:22.250649 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.250626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fk6hk" event={"ID":"3dd21bfe-b9e2-4341-9418-ce343fffdde5","Type":"ContainerStarted","Data":"e4140e29d84c0e313dd8eb1a846b3d0cd7eea153f436f5c04690f9ef9f4204c7"}
Sep 16 18:17:22.292010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.291949    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pz8t2" podStartSLOduration=66.400194447 podStartE2EDuration="1m16.29193123s" totalImagesPullingTime="9.891736783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:22.288853293 +0000 UTC m=+76.981295235" watchObservedRunningTime="2026-09-16 18:17:22.29193123 +0000 UTC m=+76.984373210"
Sep 16 18:17:22.484734 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.484674    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d5bb57f8f-d58nw" podStartSLOduration=2.103531212 podStartE2EDuration="10.484646046s" totalImagesPullingTime="8.381114834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:22.378232681 +0000 UTC m=+77.070674634" watchObservedRunningTime="2026-09-16 18:17:22.484646046 +0000 UTC m=+77.177087989"
Sep 16 18:17:22.485427 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.485379    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b97f9786d-8282s" podStartSLOduration=2.053800104 podStartE2EDuration="10.485361372s" totalImagesPullingTime="8.431561268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:22.484525972 +0000 UTC m=+77.176967930" watchObservedRunningTime="2026-09-16 18:17:22.485361372 +0000 UTC m=+77.177803312"
Sep 16 18:17:22.529066 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.528979    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fk6hk" podStartSLOduration=66.60874679 podStartE2EDuration="1m16.528960218s" totalImagesPullingTime="9.920213428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:22.527596388 +0000 UTC m=+77.220038331" watchObservedRunningTime="2026-09-16 18:17:22.528960218 +0000 UTC m=+77.221402161"
Sep 16 18:17:22.813590 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.813561    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:17:22.876507 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:22.876455    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-5ztrg" podStartSLOduration=33.509002092 podStartE2EDuration="41.876437583s" totalImagesPullingTime="8.367435491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:22.570110634 +0000 UTC m=+77.262552578" watchObservedRunningTime="2026-09-16 18:17:22.876437583 +0000 UTC m=+77.568879559"
Sep 16 18:17:25.718462 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.718429    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lpmvf"]
Sep 16 18:17:25.720732 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.720716    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.728978 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.728957    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 18:17:25.729161 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.729142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 18:17:25.729230 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.729206    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 18:17:25.729288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.729230    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 18:17:25.729388 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.729375    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 18:17:25.731945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.731929    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-976fz\""
Sep 16 18:17:25.758977 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.758953    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 18:17:25.881600 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881738 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-wtmp\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881738 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-sys\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881738 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-root\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-textfile\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-tls\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-metrics-client-ca\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.881917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.881852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klbdk\" (UniqueName: \"kubernetes.io/projected/7b6f0e32-e66f-4b9b-8307-5a7de2342473-kube-api-access-klbdk\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982282 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-sys\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982282 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-root\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982282 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-textfile\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-tls\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-sys\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-metrics-client-ca\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-root\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klbdk\" (UniqueName: \"kubernetes.io/projected/7b6f0e32-e66f-4b9b-8307-5a7de2342473-kube-api-access-klbdk\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-wtmp\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982921 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982626    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-wtmp\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.982985 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-textfile\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.983036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.982971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-metrics-client-ca\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.983111 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.983087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-accelerators-collector-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.984743 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.984719    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-tls\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:25.985598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:25.985580    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b6f0e32-e66f-4b9b-8307-5a7de2342473-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:26.004532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:26.004507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klbdk\" (UniqueName: \"kubernetes.io/projected/7b6f0e32-e66f-4b9b-8307-5a7de2342473-kube-api-access-klbdk\") pod \"node-exporter-lpmvf\" (UID: \"7b6f0e32-e66f-4b9b-8307-5a7de2342473\") " pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:26.030025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:26.030004    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lpmvf"
Sep 16 18:17:26.039229 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:17:26.039208    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6f0e32_e66f_4b9b_8307_5a7de2342473.slice/crio-0522599f83e922ba0f45e398010efa2d82aef1fa5ccf990884275627a38c6782 WatchSource:0}: Error finding container 0522599f83e922ba0f45e398010efa2d82aef1fa5ccf990884275627a38c6782: Status 404 returned error can't find the container with id 0522599f83e922ba0f45e398010efa2d82aef1fa5ccf990884275627a38c6782
Sep 16 18:17:26.266395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:26.266330    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpmvf" event={"ID":"7b6f0e32-e66f-4b9b-8307-5a7de2342473","Type":"ContainerStarted","Data":"0522599f83e922ba0f45e398010efa2d82aef1fa5ccf990884275627a38c6782"}
Sep 16 18:17:27.271574 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:27.271543    2565 generic.go:356] "Generic (PLEG): container finished" podID="7b6f0e32-e66f-4b9b-8307-5a7de2342473" containerID="b251dc770435988a95a3e79e9e7c92de7ffdb95ec7778c45a4f972d0496d96bf" exitCode=0
Sep 16 18:17:27.271975 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:27.271589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpmvf" event={"ID":"7b6f0e32-e66f-4b9b-8307-5a7de2342473","Type":"ContainerDied","Data":"b251dc770435988a95a3e79e9e7c92de7ffdb95ec7778c45a4f972d0496d96bf"}
Sep 16 18:17:28.277191 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:28.277065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpmvf" event={"ID":"7b6f0e32-e66f-4b9b-8307-5a7de2342473","Type":"ContainerStarted","Data":"29e29a27f4dcff1dd40f9721029f642c7c103d673edbdbdae8672847aec63f3c"}
Sep 16 18:17:28.277191 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:28.277123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lpmvf" event={"ID":"7b6f0e32-e66f-4b9b-8307-5a7de2342473","Type":"ContainerStarted","Data":"fbbbc6c43266dd04ba0e3c8beff53d04996a7e5ed211cb888d26207401035a3c"}
Sep 16 18:17:28.312437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:28.312389    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lpmvf" podStartSLOduration=2.169506065 podStartE2EDuration="3.312373737s" totalImagesPullingTime="1.079754699s" totalInitContainerRuntime="63.112973ms" isStatefulPod=true podCreationTimestamp="2026-09-16 18:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:17:28.311516947 +0000 UTC m=+83.003958891" watchObservedRunningTime="2026-09-16 18:17:28.312373737 +0000 UTC m=+83.004815678"
Sep 16 18:17:36.223977 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:36.223946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7875c945d7-nfrvz"
Sep 16 18:17:37.834573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:37.834520    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerName="registry" containerID="cri-o://058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03" gracePeriod=30
Sep 16 18:17:38.073485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.073456    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:17:38.172629 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172540    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9wzk\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.172629 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.172629 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172604    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.172930 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.172930 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172854    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.173061 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.172983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.173061 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.173024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.173166 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.173085    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates\") pod \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\" (UID: \"c9357a49-56d3-473b-9a0d-ad603f3d4a67\") "
Sep 16 18:17:38.173587 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.173521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:17:38.173587 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.173567    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:17:38.175688 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.175657    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:17:38.175788 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.175727    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk" (OuterVolumeSpecName: "kube-api-access-s9wzk") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "kube-api-access-s9wzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:17:38.175864 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.175813    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:17:38.175953 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.175856    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:17:38.176013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.175981    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:17:38.182525 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.182494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c9357a49-56d3-473b-9a0d-ad603f3d4a67" (UID: "c9357a49-56d3-473b-9a0d-ad603f3d4a67"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:17:38.274454 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274419    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9wzk\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-kube-api-access-s9wzk\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274454 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274450    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274454 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274462    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-image-registry-private-configuration\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274681 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274471    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9357a49-56d3-473b-9a0d-ad603f3d4a67-bound-sa-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274681 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274481    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9357a49-56d3-473b-9a0d-ad603f3d4a67-ca-trust-extracted\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274681 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274490    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9357a49-56d3-473b-9a0d-ad603f3d4a67-installation-pull-secrets\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274681 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274498    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-trusted-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.274681 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.274507    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9357a49-56d3-473b-9a0d-ad603f3d4a67-registry-certificates\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:17:38.311635 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.311606    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerID="058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03" exitCode=0
Sep 16 18:17:38.311784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.311654    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt"
Sep 16 18:17:38.311784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.311677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" event={"ID":"c9357a49-56d3-473b-9a0d-ad603f3d4a67","Type":"ContainerDied","Data":"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"}
Sep 16 18:17:38.311784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.311717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fbddcc57d-gdnbt" event={"ID":"c9357a49-56d3-473b-9a0d-ad603f3d4a67","Type":"ContainerDied","Data":"b65ee2c61693f200e1e9362d4ea5d38aef8ea329ca730dce12bf0ca4012be0f5"}
Sep 16 18:17:38.311784 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.311739    2565 scope.go:117] "RemoveContainer" containerID="058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"
Sep 16 18:17:38.321435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.321414    2565 scope.go:117] "RemoveContainer" containerID="058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"
Sep 16 18:17:38.321723 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:17:38.321703    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03\": container with ID starting with 058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03 not found: ID does not exist" containerID="058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"
Sep 16 18:17:38.321781 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.321732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03"} err="failed to get container status \"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03\": rpc error: code = NotFound desc = could not find container \"058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03\": container with ID starting with 058029a69df00d663e177c700b6e06bc6ae1ff34a3dc31e9c77c8e05b5828e03 not found: ID does not exist"
Sep 16 18:17:38.351072 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.351048    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:17:38.354159 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:38.354140    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fbddcc57d-gdnbt"]
Sep 16 18:17:39.738505 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:39.738473    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" path="/var/lib/kubelet/pods/c9357a49-56d3-473b-9a0d-ad603f3d4a67/volumes"
Sep 16 18:17:53.257591 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:17:53.257557    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pz8t2"
Sep 16 18:18:20.464511 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:18:20.464470    2565 generic.go:356] "Generic (PLEG): container finished" podID="05b07898-2e61-4221-bd8b-49f488f62833" containerID="4b33fcbfa6725be451e0e34b082b8dab50b8762cdb376453dca402a4891861f6" exitCode=0
Sep 16 18:18:20.464933 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:18:20.464554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb" event={"ID":"05b07898-2e61-4221-bd8b-49f488f62833","Type":"ContainerDied","Data":"4b33fcbfa6725be451e0e34b082b8dab50b8762cdb376453dca402a4891861f6"}
Sep 16 18:18:20.464983 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:18:20.464937    2565 scope.go:117] "RemoveContainer" containerID="4b33fcbfa6725be451e0e34b082b8dab50b8762cdb376453dca402a4891861f6"
Sep 16 18:18:21.470803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:18:21.470771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5wpkb" event={"ID":"05b07898-2e61-4221-bd8b-49f488f62833","Type":"ContainerStarted","Data":"6b1b6780c6245f288dd1dc02cf67b3cebc0afd6d676c4a54ade2bd8981015979"}
Sep 16 18:21:05.656194 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:21:05.656169    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 18:26:07.561501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.561467    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"]
Sep 16 18:26:07.561981 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.561723    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerName="registry"
Sep 16 18:26:07.561981 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.561733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerName="registry"
Sep 16 18:26:07.561981 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.561780    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9357a49-56d3-473b-9a0d-ad603f3d4a67" containerName="registry"
Sep 16 18:26:07.564490 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.564468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.567803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 18:26:07.567803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 18:26:07.567998 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567821    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 18:26:07.567998 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567829    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 18:26:07.567998 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567834    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 18:26:07.567998 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.567789    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dbp2n\""
Sep 16 18:26:07.575436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.575416    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"]
Sep 16 18:26:07.701577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.701538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.701577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.701582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2267c76-3d0d-41f2-b3e4-7468d77844c8-manager-config\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.701801 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.701665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbts\" (UniqueName: \"kubernetes.io/projected/c2267c76-3d0d-41f2-b3e4-7468d77844c8-kube-api-access-jrbts\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.701801 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.701728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-metrics-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.803090 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.803053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbts\" (UniqueName: \"kubernetes.io/projected/c2267c76-3d0d-41f2-b3e4-7468d77844c8-kube-api-access-jrbts\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.803090 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.803101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-metrics-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.803353 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.803160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.803353 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.803186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2267c76-3d0d-41f2-b3e4-7468d77844c8-manager-config\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.803912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.803869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c2267c76-3d0d-41f2-b3e4-7468d77844c8-manager-config\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.805630 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.805609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.805770 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.805747    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c2267c76-3d0d-41f2-b3e4-7468d77844c8-metrics-cert\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.811763 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.811711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbts\" (UniqueName: \"kubernetes.io/projected/c2267c76-3d0d-41f2-b3e4-7468d77844c8-kube-api-access-jrbts\") pod \"lws-controller-manager-5555c8c497-9r2gp\" (UID: \"c2267c76-3d0d-41f2-b3e4-7468d77844c8\") " pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:07.873144 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:07.873106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:08.152818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:08.152740    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"]
Sep 16 18:26:08.155553 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:26:08.155514    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2267c76_3d0d_41f2_b3e4_7468d77844c8.slice/crio-6315dddda04c97cfb7bb85fd26c12f5fab6f19c57c30db3457725f848aa85e99 WatchSource:0}: Error finding container 6315dddda04c97cfb7bb85fd26c12f5fab6f19c57c30db3457725f848aa85e99: Status 404 returned error can't find the container with id 6315dddda04c97cfb7bb85fd26c12f5fab6f19c57c30db3457725f848aa85e99
Sep 16 18:26:08.157535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:08.157520    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:26:09.036083 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:09.036042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp" event={"ID":"c2267c76-3d0d-41f2-b3e4-7468d77844c8","Type":"ContainerStarted","Data":"6315dddda04c97cfb7bb85fd26c12f5fab6f19c57c30db3457725f848aa85e99"}
Sep 16 18:26:12.049063 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:12.049022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp" event={"ID":"c2267c76-3d0d-41f2-b3e4-7468d77844c8","Type":"ContainerStarted","Data":"b25c29e26dd3953eb29284459beff5b5ead4cd93ddab5e17317d0970b5580da8"}
Sep 16 18:26:12.049453 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:12.049149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:12.066311 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:12.066263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp" podStartSLOduration=1.910240515 podStartE2EDuration="5.066248875s" totalImagesPullingTime="3.15600836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:26:12.064488268 +0000 UTC m=+606.756930220" watchObservedRunningTime="2026-09-16 18:26:12.066248875 +0000 UTC m=+606.758690816"
Sep 16 18:26:19.016925 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.016872    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"]
Sep 16 18:26:19.020312 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.020289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.022497 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.022476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 18:26:19.022790 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.022755    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 18:26:19.022903 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.022810    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 18:26:19.022967 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.022944    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r85q5\""
Sep 16 18:26:19.023047 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.023032    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 18:26:19.039686 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.039661    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"]
Sep 16 18:26:19.092823 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.092792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.093013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.092830    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-manifests\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.093013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.092859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-tmp\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.093013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.092934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2dpb\" (UniqueName: \"kubernetes.io/projected/74956e3a-f2a6-4335-869f-44774ba09604-kube-api-access-h2dpb\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.093013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.093004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.193928 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.193874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.194100 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.193936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.194100 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.193959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-manifests\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.194100 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.193989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-tmp\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.194100 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.194016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2dpb\" (UniqueName: \"kubernetes.io/projected/74956e3a-f2a6-4335-869f-44774ba09604-kube-api-access-h2dpb\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.194482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.194450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-manifests\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.196195 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.196164    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74956e3a-f2a6-4335-869f-44774ba09604-tmp\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.196425 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.196404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.196489 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.196407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/74956e3a-f2a6-4335-869f-44774ba09604-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.204070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.204047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2dpb\" (UniqueName: \"kubernetes.io/projected/74956e3a-f2a6-4335-869f-44774ba09604-kube-api-access-h2dpb\") pod \"opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj\" (UID: \"74956e3a-f2a6-4335-869f-44774ba09604\") " pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.330132 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.330094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:19.604307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:19.604283    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"]
Sep 16 18:26:19.606652 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:26:19.606618    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74956e3a_f2a6_4335_869f_44774ba09604.slice/crio-f8b6838c6c51288fd15376ae37e7af44c1f97acf73784fe441c9656dd79bf9f6 WatchSource:0}: Error finding container f8b6838c6c51288fd15376ae37e7af44c1f97acf73784fe441c9656dd79bf9f6: Status 404 returned error can't find the container with id f8b6838c6c51288fd15376ae37e7af44c1f97acf73784fe441c9656dd79bf9f6
Sep 16 18:26:20.078982 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:20.078944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj" event={"ID":"74956e3a-f2a6-4335-869f-44774ba09604","Type":"ContainerStarted","Data":"f8b6838c6c51288fd15376ae37e7af44c1f97acf73784fe441c9656dd79bf9f6"}
Sep 16 18:26:23.055247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:23.055215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5555c8c497-9r2gp"
Sep 16 18:26:23.092471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:23.092425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj" event={"ID":"74956e3a-f2a6-4335-869f-44774ba09604","Type":"ContainerStarted","Data":"98fe17472ff3ea5ac5f7675068f39631220bd9937c16bdea1cb50c9efc176b9b"}
Sep 16 18:26:24.097329 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:24.097297    2565 generic.go:356] "Generic (PLEG): container finished" podID="74956e3a-f2a6-4335-869f-44774ba09604" containerID="98fe17472ff3ea5ac5f7675068f39631220bd9937c16bdea1cb50c9efc176b9b" exitCode=0
Sep 16 18:26:24.097690 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:24.097342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj" event={"ID":"74956e3a-f2a6-4335-869f-44774ba09604","Type":"ContainerDied","Data":"98fe17472ff3ea5ac5f7675068f39631220bd9937c16bdea1cb50c9efc176b9b"}
Sep 16 18:26:25.103343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:25.103310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj" event={"ID":"74956e3a-f2a6-4335-869f-44774ba09604","Type":"ContainerStarted","Data":"61414186b51f86dfa466d94fabd187fc9a4ddf6fbdeadc2f3d2118a9e984c909"}
Sep 16 18:26:25.103731 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:25.103432    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:25.129388 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:25.129333    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj" podStartSLOduration=2.921146243 podStartE2EDuration="7.12931757s" totalImagesPullingTime="3.199957208s" totalInitContainerRuntime="1.008214119s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:26:25.1279295 +0000 UTC m=+619.820371442" watchObservedRunningTime="2026-09-16 18:26:25.12931757 +0000 UTC m=+619.821759512"
Sep 16 18:26:36.109673 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:36.109599    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj"
Sep 16 18:26:49.795222 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.795185    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f5pml"]
Sep 16 18:26:49.797105 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.797089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:49.799533 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.799506    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nshht\""
Sep 16 18:26:49.800622 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.800488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 18:26:49.807320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.807278    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f5pml"]
Sep 16 18:26:49.839304 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.839272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:49.839304 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.839302    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lr85\" (UniqueName: \"kubernetes.io/projected/3471ff75-b394-4edc-877c-11627452afcc-kube-api-access-2lr85\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:49.940234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.940201    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:49.940234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.940237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lr85\" (UniqueName: \"kubernetes.io/projected/3471ff75-b394-4edc-877c-11627452afcc-kube-api-access-2lr85\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:49.940470 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:26:49.940352    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 16 18:26:49.940470 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:26:49.940422    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert podName:3471ff75-b394-4edc-877c-11627452afcc nodeName:}" failed. No retries permitted until 2026-09-16 18:26:50.440405565 +0000 UTC m=+645.132847487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert") pod "odh-model-controller-7998c67dc4-f5pml" (UID: "3471ff75-b394-4edc-877c-11627452afcc") : secret "odh-model-controller-webhook-cert" not found
Sep 16 18:26:49.948663 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:49.948633    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lr85\" (UniqueName: \"kubernetes.io/projected/3471ff75-b394-4edc-877c-11627452afcc-kube-api-access-2lr85\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:50.327107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.327075    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwdmj"]
Sep 16 18:26:50.329607 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.329585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.331872 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.331853    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 18:26:50.340793 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.340768    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwdmj"]
Sep 16 18:26:50.442827 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.442788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.443025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.442838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s678x\" (UniqueName: \"kubernetes.io/projected/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-kube-api-access-s678x\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.443025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.442866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:50.445340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.445311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3471ff75-b394-4edc-877c-11627452afcc-cert\") pod \"odh-model-controller-7998c67dc4-f5pml\" (UID: \"3471ff75-b394-4edc-877c-11627452afcc\") " pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:50.544115 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.544073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.544311 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.544133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s678x\" (UniqueName: \"kubernetes.io/projected/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-kube-api-access-s678x\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.544311 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:26:50.544201    2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 16 18:26:50.544311 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:26:50.544280    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs podName:335bac9d-f7c2-4fa4-9701-31308b3c3ab6 nodeName:}" failed. No retries permitted until 2026-09-16 18:26:51.04426369 +0000 UTC m=+645.736705610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs") pod "model-serving-api-54d89bd5fc-lwdmj" (UID: "335bac9d-f7c2-4fa4-9701-31308b3c3ab6") : secret "model-serving-api-tls" not found
Sep 16 18:26:50.555389 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.555357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s678x\" (UniqueName: \"kubernetes.io/projected/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-kube-api-access-s678x\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:50.710614 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.710525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:50.988815 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:50.988681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-f5pml"]
Sep 16 18:26:50.991436 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:26:50.991407    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3471ff75_b394_4edc_877c_11627452afcc.slice/crio-8e66dd4bc31fe66b2fa790ffc310101f6d022a52a3bb93a65d0f52038de74507 WatchSource:0}: Error finding container 8e66dd4bc31fe66b2fa790ffc310101f6d022a52a3bb93a65d0f52038de74507: Status 404 returned error can't find the container with id 8e66dd4bc31fe66b2fa790ffc310101f6d022a52a3bb93a65d0f52038de74507
Sep 16 18:26:51.048631 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:51.048583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:51.051116 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:51.051091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/335bac9d-f7c2-4fa4-9701-31308b3c3ab6-tls-certs\") pod \"model-serving-api-54d89bd5fc-lwdmj\" (UID: \"335bac9d-f7c2-4fa4-9701-31308b3c3ab6\") " pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:51.197912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:51.197847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml" event={"ID":"3471ff75-b394-4edc-877c-11627452afcc","Type":"ContainerStarted","Data":"8e66dd4bc31fe66b2fa790ffc310101f6d022a52a3bb93a65d0f52038de74507"}
Sep 16 18:26:51.242330 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:51.242237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:51.516477 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:51.516399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lwdmj"]
Sep 16 18:26:51.519863 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:26:51.519837    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod335bac9d_f7c2_4fa4_9701_31308b3c3ab6.slice/crio-952863dc407f8efaa867961a34ab4e02c0cbb1ed769830c6ae13dd472fe51da4 WatchSource:0}: Error finding container 952863dc407f8efaa867961a34ab4e02c0cbb1ed769830c6ae13dd472fe51da4: Status 404 returned error can't find the container with id 952863dc407f8efaa867961a34ab4e02c0cbb1ed769830c6ae13dd472fe51da4
Sep 16 18:26:52.203623 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:52.203581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj" event={"ID":"335bac9d-f7c2-4fa4-9701-31308b3c3ab6","Type":"ContainerStarted","Data":"952863dc407f8efaa867961a34ab4e02c0cbb1ed769830c6ae13dd472fe51da4"}
Sep 16 18:26:55.217490 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.217450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml" event={"ID":"3471ff75-b394-4edc-877c-11627452afcc","Type":"ContainerStarted","Data":"3f69176f88b28f6afc49eb733a976f3b3bca28d20f46006d5d2234ce5e31eef3"}
Sep 16 18:26:55.217948 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.217622    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:26:55.219044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.219016    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj" event={"ID":"335bac9d-f7c2-4fa4-9701-31308b3c3ab6","Type":"ContainerStarted","Data":"65ac714ffb636d645c2219b90adb2f42fb5156d190373dfe7d9c4607674deba6"}
Sep 16 18:26:55.219159 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.219063    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:26:55.234593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.234543    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml" podStartSLOduration=2.149646277 podStartE2EDuration="6.234526987s" totalImagesPullingTime="4.08488071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:26:55.234295313 +0000 UTC m=+649.926737256" watchObservedRunningTime="2026-09-16 18:26:55.234526987 +0000 UTC m=+649.926968930"
Sep 16 18:26:55.251805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:55.251741    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj" podStartSLOduration=1.698918049 podStartE2EDuration="5.251723822s" totalImagesPullingTime="3.552805773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:26:55.250826618 +0000 UTC m=+649.943268561" watchObservedRunningTime="2026-09-16 18:26:55.251723822 +0000 UTC m=+649.944165764"
Sep 16 18:26:57.297761 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.297720    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"]
Sep 16 18:26:57.302237 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.302205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.307874 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.307849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 18:26:57.308028 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.307849    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 18:26:57.308369 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.308165    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 18:26:57.308369 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.308190    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 18:26:57.308369 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.308239    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 18:26:57.308369 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.308279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 18:26:57.308619 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.308571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-x44sq\""
Sep 16 18:26:57.322062 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.322036    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"]
Sep 16 18:26:57.406119 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406119 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8cg8\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-kube-api-access-s8cg8\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.406335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.406271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507083 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507250 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507250 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507250 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8cg8\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-kube-api-access-s8cg8\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507424 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507424 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.507424 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.507398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.508199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.508174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.509496 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.509469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.509596 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.509477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.509787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.509766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.509858 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.509839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.514986 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.514966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.515219 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.515200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8cg8\" (UniqueName: \"kubernetes.io/projected/b12cdc12-62a9-4da1-9f4f-996f1dc59dd1-kube-api-access-s8cg8\") pod \"istiod-openshift-gateway-5677ccb49b-476rf\" (UID: \"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.612032 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.611946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:26:57.911587 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:57.911560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"]
Sep 16 18:26:57.913128 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:26:57.913098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12cdc12_62a9_4da1_9f4f_996f1dc59dd1.slice/crio-8a7c82cb4a5973dc1956001a8e6af7f1ef84307f72959939d2f0c7d7ad88c3f0 WatchSource:0}: Error finding container 8a7c82cb4a5973dc1956001a8e6af7f1ef84307f72959939d2f0c7d7ad88c3f0: Status 404 returned error can't find the container with id 8a7c82cb4a5973dc1956001a8e6af7f1ef84307f72959939d2f0c7d7ad88c3f0
Sep 16 18:26:58.234217 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:26:58.234128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf" event={"ID":"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1","Type":"ContainerStarted","Data":"8a7c82cb4a5973dc1956001a8e6af7f1ef84307f72959939d2f0c7d7ad88c3f0"}
Sep 16 18:27:00.173683 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:00.173636    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:27:00.173999 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:00.173729    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:27:01.250074 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:01.250037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf" event={"ID":"b12cdc12-62a9-4da1-9f4f-996f1dc59dd1","Type":"ContainerStarted","Data":"be27c03e07036ec5c8f55fc86b37ef11ef6356b09da37fbfd261c875a6d108a7"}
Sep 16 18:27:01.250502 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:01.250192    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:27:01.251556 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:01.251529    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf"
Sep 16 18:27:01.278882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:01.278835    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-476rf" podStartSLOduration=2.020585281 podStartE2EDuration="4.278819031s" totalImagesPullingTime="2.25823375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:27:01.277467408 +0000 UTC m=+655.969909397" watchObservedRunningTime="2026-09-16 18:27:01.278819031 +0000 UTC m=+655.971260973"
Sep 16 18:27:06.225467 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:06.225434    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-f5pml"
Sep 16 18:27:06.227637 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:27:06.227609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lwdmj"
Sep 16 18:30:39.244208 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.244168    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:30:39.246773 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.246750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.251287 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.251267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-r78k9\""
Sep 16 18:30:39.252343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.252315    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 18:30:39.252457 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.252404    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 18:30:39.260943 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.260919    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 18:30:39.261080 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.261031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 18:30:39.263350 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.263318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:30:39.391237 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.391200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.391431 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.391256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdv2g\" (UniqueName: \"kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.391431 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.391343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.391431 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.391401    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.492448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.492409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.492448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.492453    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.492677 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.492631    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.492742 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.492695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdv2g\" (UniqueName: \"kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.493263 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.493234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.495095 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.495042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.495202 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.495096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.501093 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.501068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdv2g\" (UniqueName: \"kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g\") pod \"maas-api-6ddb7ffb7f-ds6wd\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") " pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.556802 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.556766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:39.839691 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.839567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:30:39.842466 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:30:39.842433    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c7aa513_f7bf_4f82_8131_72491ab2065a.slice/crio-adb5ad85395479d7587f7484db2806ccaf229358b070d0a274701fcdaa764dde WatchSource:0}: Error finding container adb5ad85395479d7587f7484db2806ccaf229358b070d0a274701fcdaa764dde: Status 404 returned error can't find the container with id adb5ad85395479d7587f7484db2806ccaf229358b070d0a274701fcdaa764dde
Sep 16 18:30:39.857503 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.857473    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"]
Sep 16 18:30:39.861120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.861101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:39.863560 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.863538    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-54t9j\""
Sep 16 18:30:39.863835 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.863822    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 18:30:39.876141 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.876119    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"]
Sep 16 18:30:39.997977 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.997937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:39.998151 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:39.997989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbl6w\" (UniqueName: \"kubernetes.io/projected/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-kube-api-access-kbl6w\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.099490 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.099389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbl6w\" (UniqueName: \"kubernetes.io/projected/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-kube-api-access-kbl6w\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.099490 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.099495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.100167 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.100149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.108429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.108407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbl6w\" (UniqueName: \"kubernetes.io/projected/20490f9a-8a82-43ab-b4f4-c937ec0e4d9b-kube-api-access-kbl6w\") pod \"payload-pre-processing-59fbc47bf8-kxd7h\" (UID: \"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.109210 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.109189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" event={"ID":"4c7aa513-f7bf-4f82-8131-72491ab2065a","Type":"ContainerStarted","Data":"adb5ad85395479d7587f7484db2806ccaf229358b070d0a274701fcdaa764dde"}
Sep 16 18:30:40.171297 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.171258    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:40.442782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:40.442759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"]
Sep 16 18:30:40.444804 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:30:40.444772    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20490f9a_8a82_43ab_b4f4_c937ec0e4d9b.slice/crio-08a2572b044de4639e6be45fcfef0e917e8199e5a7f84cd28f144a1ef837117c WatchSource:0}: Error finding container 08a2572b044de4639e6be45fcfef0e917e8199e5a7f84cd28f144a1ef837117c: Status 404 returned error can't find the container with id 08a2572b044de4639e6be45fcfef0e917e8199e5a7f84cd28f144a1ef837117c
Sep 16 18:30:41.115264 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:41.115222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h" event={"ID":"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b","Type":"ContainerStarted","Data":"08a2572b044de4639e6be45fcfef0e917e8199e5a7f84cd28f144a1ef837117c"}
Sep 16 18:30:44.130421 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.130390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h" event={"ID":"20490f9a-8a82-43ab-b4f4-c937ec0e4d9b","Type":"ContainerStarted","Data":"9cdca4866c5ef5ff45aba30bb0b5406cbd5fe7e95ddf51ed978bb8787fbb5bbf"}
Sep 16 18:30:44.130778 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.130499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:30:44.132346 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.132313    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" event={"ID":"4c7aa513-f7bf-4f82-8131-72491ab2065a","Type":"ContainerStarted","Data":"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"}
Sep 16 18:30:44.132464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.132363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:44.148356 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.148297    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h" podStartSLOduration=1.5656283659999999 podStartE2EDuration="5.148276057s" totalImagesPullingTime="3.582647691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:44.147093016 +0000 UTC m=+878.839534959" watchObservedRunningTime="2026-09-16 18:30:44.148276057 +0000 UTC m=+878.840718000"
Sep 16 18:30:44.165966 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:44.165909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" podStartSLOduration=0.935468152 podStartE2EDuration="5.165870354s" totalImagesPullingTime="4.230402202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:30:44.164259268 +0000 UTC m=+878.856701208" watchObservedRunningTime="2026-09-16 18:30:44.165870354 +0000 UTC m=+878.858312344"
Sep 16 18:30:50.142643 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:50.142609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:30:55.139539 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:30:55.139507    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kxd7h"
Sep 16 18:31:00.908598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.908520    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"]
Sep 16 18:31:00.912155 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.912133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.915540 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.915520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 16 18:31:00.915614 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.915546    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 18:31:00.915614 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.915520    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5zsbs\""
Sep 16 18:31:00.915723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.915639    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 18:31:00.921607 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.921583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"]
Sep 16 18:31:00.967454 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.967583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.967583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967525    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.967657 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.967657 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cknbh\" (UniqueName: \"kubernetes.io/projected/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-kube-api-access-cknbh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:00.967729 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:00.967666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.068794 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.068758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.068812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.068931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.068997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069187 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.069043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cknbh\" (UniqueName: \"kubernetes.io/projected/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-kube-api-access-cknbh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069187 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.069070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069326 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.069305    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069393 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.069373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.069431 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.069391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.071033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.071017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.071364 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.071348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.077448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.077424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cknbh\" (UniqueName: \"kubernetes.io/projected/b450d28d-12b8-4e1b-b4ae-1c647bf9413c-kube-api-access-cknbh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jnxk7\" (UID: \"b450d28d-12b8-4e1b-b4ae-1c647bf9413c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.238757 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.238669    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:01.511302 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:01.511276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"]
Sep 16 18:31:01.513331 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:31:01.513299    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb450d28d_12b8_4e1b_b4ae_1c647bf9413c.slice/crio-0f0bd863e520790f0e0fa0846d6227ad74cef417da89aa791fc0753b450e4c79 WatchSource:0}: Error finding container 0f0bd863e520790f0e0fa0846d6227ad74cef417da89aa791fc0753b450e4c79: Status 404 returned error can't find the container with id 0f0bd863e520790f0e0fa0846d6227ad74cef417da89aa791fc0753b450e4c79
Sep 16 18:31:02.212743 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:02.212700    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7" event={"ID":"b450d28d-12b8-4e1b-b4ae-1c647bf9413c","Type":"ContainerStarted","Data":"0f0bd863e520790f0e0fa0846d6227ad74cef417da89aa791fc0753b450e4c79"}
Sep 16 18:31:03.218405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:03.218365    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7" event={"ID":"b450d28d-12b8-4e1b-b4ae-1c647bf9413c","Type":"ContainerStarted","Data":"b37678bed25b653b5385ee0d656023783c70300c8fbcf0f58fb1968a8650d858"}
Sep 16 18:31:03.236586 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:03.236535    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7" podStartSLOduration=2.2764806269999998 podStartE2EDuration="3.236516471s" totalImagesPullingTime="960.035844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:31:03.235791994 +0000 UTC m=+897.928233937" watchObservedRunningTime="2026-09-16 18:31:03.236516471 +0000 UTC m=+897.928958442"
Sep 16 18:31:11.239615 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:11.239576    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:11.240155 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:11.239629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:11.252627 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:11.252601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:11.264141 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:11.264119    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jnxk7"
Sep 16 18:31:46.618930 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.618877    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"]
Sep 16 18:31:46.621076 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.621057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.623864 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.623839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 16 18:31:46.638258 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.638234    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"]
Sep 16 18:31:46.752120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8tf4\" (UniqueName: \"kubernetes.io/projected/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-kube-api-access-j8tf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.752120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.752359 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.752359 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.752359 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.752359 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.752279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853505 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853698 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8tf4\" (UniqueName: \"kubernetes.io/projected/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-kube-api-access-j8tf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853698 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853698 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.853879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.854029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.853955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.854088 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.854056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.854591 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.854326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.856971 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.856938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.857313 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.857291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.862803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.862777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8tf4\" (UniqueName: \"kubernetes.io/projected/a91b27a7-47b1-4dbe-93dd-b16bb3a820b1-kube-api-access-j8tf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m7w4z\" (UID: \"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:46.931920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:46.931808    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:47.225231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:47.225120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"]
Sep 16 18:31:47.228956 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:31:47.228924    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91b27a7_47b1_4dbe_93dd_b16bb3a820b1.slice/crio-fa2b08c373b034c62b63aa6bfd6fa28e12c0b0c5df81a57321585c66d220085a WatchSource:0}: Error finding container fa2b08c373b034c62b63aa6bfd6fa28e12c0b0c5df81a57321585c66d220085a: Status 404 returned error can't find the container with id fa2b08c373b034c62b63aa6bfd6fa28e12c0b0c5df81a57321585c66d220085a
Sep 16 18:31:47.230283 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:47.230264    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:31:47.395660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:47.395627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z" event={"ID":"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1","Type":"ContainerStarted","Data":"fa2b08c373b034c62b63aa6bfd6fa28e12c0b0c5df81a57321585c66d220085a"}
Sep 16 18:31:48.403658 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:48.403618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z" event={"ID":"a91b27a7-47b1-4dbe-93dd-b16bb3a820b1","Type":"ContainerStarted","Data":"236a63a51211d41f3128efb4839e4f57b09268fd20f23411e9021cefc85ab75c"}
Sep 16 18:31:48.439804 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:48.439751    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z" podStartSLOduration=2.265692342 podStartE2EDuration="2.439731957s" totalImagesPullingTime="174.039615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:31:48.439441218 +0000 UTC m=+943.131883165" watchObservedRunningTime="2026-09-16 18:31:48.439731957 +0000 UTC m=+943.132173899"
Sep 16 18:31:56.932910 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:56.932863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:56.934402 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:56.932962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:56.945371 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:56.945348    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:31:57.450993 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:31:57.450966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m7w4z"
Sep 16 18:32:25.373713 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.373678    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"]
Sep 16 18:32:25.376416 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.376393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.380084 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.380059    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 18:32:25.410405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.410365    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"]
Sep 16 18:32:25.475909 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.475854    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.475909 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.475907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.476184 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.475985    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.476184 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.476098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvhb\" (UniqueName: \"kubernetes.io/projected/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-kube-api-access-mhvhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.476184 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.476139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.476305 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.476190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577388 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvhb\" (UniqueName: \"kubernetes.io/projected/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-kube-api-access-mhvhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577502    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.577982 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.578115 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.577994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.578115 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.578011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.579858 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.579841    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.580127 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.580110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.587670 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.587649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvhb\" (UniqueName: \"kubernetes.io/projected/3ed0cfe6-1d44-4ecd-86d2-9b95578db070-kube-api-access-mhvhb\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mt2cg\" (UID: \"3ed0cfe6-1d44-4ecd-86d2-9b95578db070\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.689037 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.688884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:25.965224 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:25.965197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"]
Sep 16 18:32:25.967369 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:32:25.967331    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ed0cfe6_1d44_4ecd_86d2_9b95578db070.slice/crio-ca93269f1d47dad5a4527aeca9d65908a0e2afa6175886a43927f72e4cab63e8 WatchSource:0}: Error finding container ca93269f1d47dad5a4527aeca9d65908a0e2afa6175886a43927f72e4cab63e8: Status 404 returned error can't find the container with id ca93269f1d47dad5a4527aeca9d65908a0e2afa6175886a43927f72e4cab63e8
Sep 16 18:32:26.562230 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:26.562190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg" event={"ID":"3ed0cfe6-1d44-4ecd-86d2-9b95578db070","Type":"ContainerStarted","Data":"761d5c7703054389d3944d4d2bed741ed624d2fcedf6dd2fcbd7908a24ac9ef1"}
Sep 16 18:32:26.562674 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:26.562255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg" event={"ID":"3ed0cfe6-1d44-4ecd-86d2-9b95578db070","Type":"ContainerStarted","Data":"ca93269f1d47dad5a4527aeca9d65908a0e2afa6175886a43927f72e4cab63e8"}
Sep 16 18:32:26.590718 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:26.590662    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg" podStartSLOduration=1.394696305 podStartE2EDuration="1.590645945s" totalImagesPullingTime="195.94964ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:32:26.588709302 +0000 UTC m=+981.281151243" watchObservedRunningTime="2026-09-16 18:32:26.590645945 +0000 UTC m=+981.283087887"
Sep 16 18:32:35.689220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:35.689126    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:35.689220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:35.689193    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:35.701650 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:35.701616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:32:36.613828 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:32:36.613796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mt2cg"
Sep 16 18:34:18.265958 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.265857    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:34:18.269169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.269146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.274988 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.274958    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4ab744-serving-cert\""
Sep 16 18:34:18.320529 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.320496    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:34:18.348182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.348136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkhk5\" (UniqueName: \"kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.348339 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.348204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.348339 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.348257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.348339 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.348316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.449105 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.449070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.449273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.449115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.449273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.449148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.449273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.449222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkhk5\" (UniqueName: \"kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.449273 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:34:18.449229    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-serving-cert: secret "maas-api-e2e-inf-a-4ab744-serving-cert" not found
Sep 16 18:34:18.449422 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:34:18.449300    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls podName:9d905ff2-3fe1-40c0-8bbe-58530fa128b2 nodeName:}" failed. No retries permitted until 2026-09-16 18:34:18.94928174 +0000 UTC m=+1093.641723659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls") pod "maas-api-e2e-inf-a-4ab744-588d867765-scq7q" (UID: "9d905ff2-3fe1-40c0-8bbe-58530fa128b2") : secret "maas-api-e2e-inf-a-4ab744-serving-cert" not found
Sep 16 18:34:18.450046 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.450015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.451779 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.451754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.469490 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.469457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkhk5\" (UniqueName: \"kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.954755 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.954719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:18.957126 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:18.957108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") pod \"maas-api-e2e-inf-a-4ab744-588d867765-scq7q\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:19.180834 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:19.180799    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:19.484876 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:19.484849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:34:19.487523 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:19.487486    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d905ff2_3fe1_40c0_8bbe_58530fa128b2.slice/crio-83dc77dbc57db41a8f2d803a687e9a8442836e93f8773a86f34cfe157cb3aa13 WatchSource:0}: Error finding container 83dc77dbc57db41a8f2d803a687e9a8442836e93f8773a86f34cfe157cb3aa13: Status 404 returned error can't find the container with id 83dc77dbc57db41a8f2d803a687e9a8442836e93f8773a86f34cfe157cb3aa13
Sep 16 18:34:20.040079 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.040043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" event={"ID":"9d905ff2-3fe1-40c0-8bbe-58530fa128b2","Type":"ContainerStarted","Data":"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"}
Sep 16 18:34:20.040220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.040101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" event={"ID":"9d905ff2-3fe1-40c0-8bbe-58530fa128b2","Type":"ContainerStarted","Data":"83dc77dbc57db41a8f2d803a687e9a8442836e93f8773a86f34cfe157cb3aa13"}
Sep 16 18:34:20.040220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.040141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:20.711025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.710963    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" podStartSLOduration=2.239999923 podStartE2EDuration="2.710939565s" totalImagesPullingTime="470.939642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:20.099435091 +0000 UTC m=+1094.791877034" watchObservedRunningTime="2026-09-16 18:34:20.710939565 +0000 UTC m=+1095.403381510"
Sep 16 18:34:20.711806 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.711783    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:34:20.715674 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.715650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.718652 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.718630    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-909a40-serving-cert\""
Sep 16 18:34:20.746183 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.746152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:34:20.873051 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.873006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.873247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.873086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.873247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.873165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8khxb\" (UniqueName: \"kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.873247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.873226    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.973790 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.973703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.973790 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.973764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.973989 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.973818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.974026 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:34:20.973996    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-serving-cert: secret "maas-api-e2e-worker-w0-909a40-serving-cert" not found
Sep 16 18:34:20.974080 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:34:20.974066    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls podName:01ea5ebc-c666-49b3-9844-18b2b806580f nodeName:}" failed. No retries permitted until 2026-09-16 18:34:21.474045089 +0000 UTC m=+1096.166487032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls") pod "maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" (UID: "01ea5ebc-c666-49b3-9844-18b2b806580f") : secret "maas-api-e2e-worker-w0-909a40-serving-cert" not found
Sep 16 18:34:20.974138 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.974102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8khxb\" (UniqueName: \"kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.974541 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.974508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:20.976317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:20.976296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:21.004182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:21.004143    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8khxb\" (UniqueName: \"kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:21.480010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:21.479964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:21.482423 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:21.482404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:21.628608 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:21.628569    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:21.939451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:21.939412    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:34:21.944405 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:21.944378    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ea5ebc_c666_49b3_9844_18b2b806580f.slice/crio-2bf88fabf76481aebcfdc5e19a19f2a728a53e718d46f40a2f85dc3369478d3f WatchSource:0}: Error finding container 2bf88fabf76481aebcfdc5e19a19f2a728a53e718d46f40a2f85dc3369478d3f: Status 404 returned error can't find the container with id 2bf88fabf76481aebcfdc5e19a19f2a728a53e718d46f40a2f85dc3369478d3f
Sep 16 18:34:22.049886 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:22.049848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" event={"ID":"01ea5ebc-c666-49b3-9844-18b2b806580f","Type":"ContainerStarted","Data":"2bf88fabf76481aebcfdc5e19a19f2a728a53e718d46f40a2f85dc3369478d3f"}
Sep 16 18:34:23.056021 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.055983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" event={"ID":"01ea5ebc-c666-49b3-9844-18b2b806580f","Type":"ContainerStarted","Data":"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"}
Sep 16 18:34:23.056447 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.056057    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:23.134887 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.134835    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" podStartSLOduration=2.6321640889999998 podStartE2EDuration="3.134819814s" totalImagesPullingTime="502.655725ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:23.13324271 +0000 UTC m=+1097.825684652" watchObservedRunningTime="2026-09-16 18:34:23.134819814 +0000 UTC m=+1097.827261756"
Sep 16 18:34:23.324576 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.324495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:34:23.327831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.327814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.344054 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.344030    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-909a40-dockercfg-687fs\""
Sep 16 18:34:23.354711 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.354688    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-909a40\""
Sep 16 18:34:23.378426 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.378402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:34:23.499148 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.499113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.499326 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.499300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fqc9\" (UniqueName: \"kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.600455 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.600364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fqc9\" (UniqueName: \"kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.600455 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.600414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.601231 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.601210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.630678 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.630651    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fqc9\" (UniqueName: \"kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9\") pod \"payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.637978 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.637954    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:23.945393 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:23.945358    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a33244_1482_4945_a6f5_78675f597827.slice/crio-7523a562a6bd36cbd7eac272802a845a94d90439d727f933a2b3e3c0669cc4c3 WatchSource:0}: Error finding container 7523a562a6bd36cbd7eac272802a845a94d90439d727f933a2b3e3c0669cc4c3: Status 404 returned error can't find the container with id 7523a562a6bd36cbd7eac272802a845a94d90439d727f933a2b3e3c0669cc4c3
Sep 16 18:34:23.948276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:23.948240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:34:24.061757 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.061718    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" event={"ID":"81a33244-1482-4945-a6f5-78675f597827","Type":"ContainerStarted","Data":"ea2c1a6519229ef963beddd9a175b68a4caf3220e06d950f43870fbe660141d3"}
Sep 16 18:34:24.062162 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.061773    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" event={"ID":"81a33244-1482-4945-a6f5-78675f597827","Type":"ContainerStarted","Data":"7523a562a6bd36cbd7eac272802a845a94d90439d727f933a2b3e3c0669cc4c3"}
Sep 16 18:34:24.138961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.138909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" podStartSLOduration=1.138876115 podStartE2EDuration="1.138876115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:24.13788728 +0000 UTC m=+1098.830329221" watchObservedRunningTime="2026-09-16 18:34:24.138876115 +0000 UTC m=+1098.831318056"
Sep 16 18:34:24.524766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.524036    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:34:24.528257 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.528209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.554218 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.554184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-d8a600-serving-cert\""
Sep 16 18:34:24.576599 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.576570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:34:24.710996 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.710955    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.711146 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.711016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.711146 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.711103    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.711254 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.711159    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9kct\" (UniqueName: \"kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.811691 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.811655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.811870 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.811706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9kct\" (UniqueName: \"kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.811870 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.811745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.811870 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.811776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.812499 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.812458    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.814140 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.814119    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.814666 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.814645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.831593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.831565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9kct\" (UniqueName: \"kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct\") pod \"maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:24.840393 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:24.840372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:25.065810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:25.065724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:25.148860 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:25.148832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:34:25.150174 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:25.150146    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe854a7_d091_467b_b6b9_c3bce096cc77.slice/crio-b83558ee7ba64db44828e73d4c70afb8dadfccda27d5500588ef3cd849708545 WatchSource:0}: Error finding container b83558ee7ba64db44828e73d4c70afb8dadfccda27d5500588ef3cd849708545: Status 404 returned error can't find the container with id b83558ee7ba64db44828e73d4c70afb8dadfccda27d5500588ef3cd849708545
Sep 16 18:34:26.050422 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:26.050394    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:34:26.071541 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:26.071502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" event={"ID":"6fe854a7-d091-467b-b6b9-c3bce096cc77","Type":"ContainerStarted","Data":"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"}
Sep 16 18:34:26.072002 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:26.071568    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" event={"ID":"6fe854a7-d091-467b-b6b9-c3bce096cc77","Type":"ContainerStarted","Data":"b83558ee7ba64db44828e73d4c70afb8dadfccda27d5500588ef3cd849708545"}
Sep 16 18:34:26.072002 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:26.071724    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:26.236879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:26.236818    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" podStartSLOduration=1.810211939 podStartE2EDuration="2.236795304s" totalImagesPullingTime="426.583365ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:26.234725319 +0000 UTC m=+1100.927167261" watchObservedRunningTime="2026-09-16 18:34:26.236795304 +0000 UTC m=+1100.929237247"
Sep 16 18:34:29.067308 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:29.067276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:34:32.081056 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:32.081026    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:34:36.073520 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:36.073489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:34:45.551878 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.551831    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:34:45.555483 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.555463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.562526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.562353    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-8b875d-serving-cert\""
Sep 16 18:34:45.660393 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.660359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:34:45.698040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.698006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.698249 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.698106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.698249 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.698139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.698249 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.698206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46m74\" (UniqueName: \"kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.798810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.798772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46m74\" (UniqueName: \"kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.799026 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.798831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.799026 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.798964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.799026 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.798997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.799609 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.799588    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.801462 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.801440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.801528 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.801498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.858658 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.858590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46m74\" (UniqueName: \"kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74\") pod \"maas-api-e2e-autores-8b875d-5d64c9848f-l77xh\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:45.866422 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:45.866393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:46.212260 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:46.212237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:34:46.214074 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:46.214041    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18947c1d_dd0c_4462_a3c6_f56cfe2e5031.slice/crio-cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2 WatchSource:0}: Error finding container cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2: Status 404 returned error can't find the container with id cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2
Sep 16 18:34:47.168867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:47.168825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" event={"ID":"18947c1d-dd0c-4462-a3c6-f56cfe2e5031","Type":"ContainerStarted","Data":"605a1cd3cb3ba1c2c6d9e92a2f869e7af1d80af3a038520a2e8d319dba3fb09c"}
Sep 16 18:34:47.169308 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:47.168927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" event={"ID":"18947c1d-dd0c-4462-a3c6-f56cfe2e5031","Type":"ContainerStarted","Data":"cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2"}
Sep 16 18:34:47.169308 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:47.168951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:53.178722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:53.178691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:34:53.372386 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:53.372330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" podStartSLOduration=7.931808213 podStartE2EDuration="8.372312692s" totalImagesPullingTime="440.504479ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:47.517593415 +0000 UTC m=+1122.210035357" watchObservedRunningTime="2026-09-16 18:34:53.372312692 +0000 UTC m=+1128.064754634"
Sep 16 18:34:55.523573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.523535    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:34:55.527874 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.527852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.533320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.533291    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-119aafd2-serving-cert\""
Sep 16 18:34:55.604787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.604750    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:34:55.692559 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.692523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.692753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.692619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr9ct\" (UniqueName: \"kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.692812 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.692768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.692928 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.692863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.794397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.794354    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr9ct\" (UniqueName: \"kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.794601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.794419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.794601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.794442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.794601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.794505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.795091 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.795071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.796907 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.796869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.797000 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.796933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.821055 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.821029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr9ct\" (UniqueName: \"kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct\") pod \"maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:55.839047 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:55.839021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:56.173167 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:56.173139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:34:56.174378 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:56.174352    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad787243_9294_488a_8b86_cef6af697270.slice/crio-e206262f422cbca51ac94da4ee7b5472629ff0697332ed5883685e909103b819 WatchSource:0}: Error finding container e206262f422cbca51ac94da4ee7b5472629ff0697332ed5883685e909103b819: Status 404 returned error can't find the container with id e206262f422cbca51ac94da4ee7b5472629ff0697332ed5883685e909103b819
Sep 16 18:34:56.209049 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:56.209009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" event={"ID":"ad787243-9294-488a-8b86-cef6af697270","Type":"ContainerStarted","Data":"e206262f422cbca51ac94da4ee7b5472629ff0697332ed5883685e909103b819"}
Sep 16 18:34:57.216816 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:57.216780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" event={"ID":"ad787243-9294-488a-8b86-cef6af697270","Type":"ContainerStarted","Data":"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"}
Sep 16 18:34:57.217302 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:57.216915    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:34:58.082844 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.082790    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" podStartSLOduration=2.7104826539999998 podStartE2EDuration="3.082771414s" totalImagesPullingTime="372.28876ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:57.333712923 +0000 UTC m=+1132.026154866" watchObservedRunningTime="2026-09-16 18:34:58.082771414 +0000 UTC m=+1132.775213356"
Sep 16 18:34:58.083366 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.083352    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:34:58.086747 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.086730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.093989 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.093969    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-119aafd2\""
Sep 16 18:34:58.094342 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.094320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-119aafd2-dockercfg-hppvb\""
Sep 16 18:34:58.143015 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.142929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:34:58.218508 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.218477    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.218966 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.218517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2kqc\" (UniqueName: \"kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.319043 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.319011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2kqc\" (UniqueName: \"kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.319324 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.319298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.320015 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.319989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.340150 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.340079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2kqc\" (UniqueName: \"kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc\") pod \"payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") " pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.397003 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.396965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:58.699254 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:58.699166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:34:58.706180 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:34:58.706153    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94ad75eb_739e_45fb_8ada_f7c50ff561e7.slice/crio-8a3439e27d53df06e10934b19fd2ef1fde01242c7d86d271faa87c44aac4307c WatchSource:0}: Error finding container 8a3439e27d53df06e10934b19fd2ef1fde01242c7d86d271faa87c44aac4307c: Status 404 returned error can't find the container with id 8a3439e27d53df06e10934b19fd2ef1fde01242c7d86d271faa87c44aac4307c
Sep 16 18:34:59.227133 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:59.227089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" event={"ID":"94ad75eb-739e-45fb-8ada-f7c50ff561e7","Type":"ContainerStarted","Data":"0afa7716ffeba8d7440bec60e40e092e25ce83ee44e9d891d84b459f0fe7e93f"}
Sep 16 18:34:59.227563 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:59.227147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" event={"ID":"94ad75eb-739e-45fb-8ada-f7c50ff561e7","Type":"ContainerStarted","Data":"8a3439e27d53df06e10934b19fd2ef1fde01242c7d86d271faa87c44aac4307c"}
Sep 16 18:34:59.227563 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:59.227203    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:34:59.305988 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:34:59.305929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" podStartSLOduration=1.305905514 podStartE2EDuration="1.305905514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:34:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:34:59.303282341 +0000 UTC m=+1133.995724317" watchObservedRunningTime="2026-09-16 18:34:59.305905514 +0000 UTC m=+1133.998347450"
Sep 16 18:35:03.227023 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:03.226996    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:35:05.716860 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.716816    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:35:05.720378 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.720359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.726243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.726221    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6ef84e-serving-cert\""
Sep 16 18:35:05.789966 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.789933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:35:05.890237 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.890197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.890414 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.890242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.890414 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.890275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjbv\" (UniqueName: \"kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.890414 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.890344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.991449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.991363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.991449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.991414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.991449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.991443    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjbv\" (UniqueName: \"kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.991671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.991466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.992142 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.992105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.994018 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.993993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:05.994120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:05.993997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:06.010721 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:06.010696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjbv\" (UniqueName: \"kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv\") pod \"maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:06.030088 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:06.030054    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:06.338408 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:06.338385    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:35:06.340610 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:35:06.340582    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42d92ca_2f52_4dc5_a24d_83f53833b770.slice/crio-01aa921a2930ff5bfb892da470f5c05bf98ea1f7583764bb976807157cd28776 WatchSource:0}: Error finding container 01aa921a2930ff5bfb892da470f5c05bf98ea1f7583764bb976807157cd28776: Status 404 returned error can't find the container with id 01aa921a2930ff5bfb892da470f5c05bf98ea1f7583764bb976807157cd28776
Sep 16 18:35:07.263845 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:07.263809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" event={"ID":"e42d92ca-2f52-4dc5-a24d-83f53833b770","Type":"ContainerStarted","Data":"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"}
Sep 16 18:35:07.264285 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:07.263930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:07.264285 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:07.263953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" event={"ID":"e42d92ca-2f52-4dc5-a24d-83f53833b770","Type":"ContainerStarted","Data":"01aa921a2930ff5bfb892da470f5c05bf98ea1f7583764bb976807157cd28776"}
Sep 16 18:35:07.312990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:07.312933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" podStartSLOduration=1.996418689 podStartE2EDuration="2.312917345s" totalImagesPullingTime="316.498656ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:35:07.311764158 +0000 UTC m=+1142.004206100" watchObservedRunningTime="2026-09-16 18:35:07.312917345 +0000 UTC m=+1142.005359281"
Sep 16 18:35:10.234750 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:10.234716    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:35:13.274220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:13.274190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:35:33.088501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.088421    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:35:33.089017 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.088627    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" podUID="ad787243-9294-488a-8b86-cef6af697270" containerName="maas-api" containerID="cri-o://3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b" gracePeriod=30
Sep 16 18:35:33.222527 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.222491    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" podUID="ad787243-9294-488a-8b86-cef6af697270" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.32:8443/health\": dial tcp 10.133.0.32:8443: connect: connection refused"
Sep 16 18:35:33.229196 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.229169    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:35:33.229390 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.229366    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" podUID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" containerName="payload-processing" containerID="cri-o://0afa7716ffeba8d7440bec60e40e092e25ce83ee44e9d891d84b459f0fe7e93f" gracePeriod=30
Sep 16 18:35:33.355551 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.355523    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:35:33.383806 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.383772    2565 generic.go:356] "Generic (PLEG): container finished" podID="ad787243-9294-488a-8b86-cef6af697270" containerID="3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b" exitCode=0
Sep 16 18:35:33.384012 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.383835    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"
Sep 16 18:35:33.384012 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.383866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" event={"ID":"ad787243-9294-488a-8b86-cef6af697270","Type":"ContainerDied","Data":"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"}
Sep 16 18:35:33.384012 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.383941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg" event={"ID":"ad787243-9294-488a-8b86-cef6af697270","Type":"ContainerDied","Data":"e206262f422cbca51ac94da4ee7b5472629ff0697332ed5883685e909103b819"}
Sep 16 18:35:33.384012 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.383969    2565 scope.go:117] "RemoveContainer" containerID="3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"
Sep 16 18:35:33.386047 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.386023    2565 generic.go:356] "Generic (PLEG): container finished" podID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" containerID="0afa7716ffeba8d7440bec60e40e092e25ce83ee44e9d891d84b459f0fe7e93f" exitCode=0
Sep 16 18:35:33.386164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.386093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" event={"ID":"94ad75eb-739e-45fb-8ada-f7c50ff561e7","Type":"ContainerDied","Data":"0afa7716ffeba8d7440bec60e40e092e25ce83ee44e9d891d84b459f0fe7e93f"}
Sep 16 18:35:33.392818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.392783    2565 scope.go:117] "RemoveContainer" containerID="3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"
Sep 16 18:35:33.393099 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:35:33.393074    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b\": container with ID starting with 3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b not found: ID does not exist" containerID="3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"
Sep 16 18:35:33.393148 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.393109    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b"} err="failed to get container status \"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b\": rpc error: code = NotFound desc = could not find container \"3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b\": container with ID starting with 3ca69f92fd0325bd72d5dcc0c993d206c9350296ec276cb112ab8f11293f1a9b not found: ID does not exist"
Sep 16 18:35:33.442157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.442127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr9ct\" (UniqueName: \"kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct\") pod \"ad787243-9294-488a-8b86-cef6af697270\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") "
Sep 16 18:35:33.442358 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.442208    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs\") pod \"ad787243-9294-488a-8b86-cef6af697270\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") "
Sep 16 18:35:33.442358 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.442293    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls\") pod \"ad787243-9294-488a-8b86-cef6af697270\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") "
Sep 16 18:35:33.442545 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.442360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca\") pod \"ad787243-9294-488a-8b86-cef6af697270\" (UID: \"ad787243-9294-488a-8b86-cef6af697270\") "
Sep 16 18:35:33.442994 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.442959    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad787243-9294-488a-8b86-cef6af697270" (UID: "ad787243-9294-488a-8b86-cef6af697270"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:35:33.444735 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.444695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad787243-9294-488a-8b86-cef6af697270" (UID: "ad787243-9294-488a-8b86-cef6af697270"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:35:33.444849 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.444739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct" (OuterVolumeSpecName: "kube-api-access-rr9ct") pod "ad787243-9294-488a-8b86-cef6af697270" (UID: "ad787243-9294-488a-8b86-cef6af697270"). InnerVolumeSpecName "kube-api-access-rr9ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:35:33.444849 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.444785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ad787243-9294-488a-8b86-cef6af697270" (UID: "ad787243-9294-488a-8b86-cef6af697270"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:35:33.470512 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.470486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:35:33.543238 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume\") pod \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") "
Sep 16 18:35:33.543424 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2kqc\" (UniqueName: \"kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc\") pod \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\" (UID: \"94ad75eb-739e-45fb-8ada-f7c50ff561e7\") "
Sep 16 18:35:33.543651 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543627    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94ad75eb-739e-45fb-8ada-f7c50ff561e7" (UID: "94ad75eb-739e-45fb-8ada-f7c50ff561e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:35:33.543722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543637    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.543722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543677    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad787243-9294-488a-8b86-cef6af697270-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.543722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543688    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad787243-9294-488a-8b86-cef6af697270-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.543722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.543697    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr9ct\" (UniqueName: \"kubernetes.io/projected/ad787243-9294-488a-8b86-cef6af697270-kube-api-access-rr9ct\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.545567 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.545541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc" (OuterVolumeSpecName: "kube-api-access-t2kqc") pod "94ad75eb-739e-45fb-8ada-f7c50ff561e7" (UID: "94ad75eb-739e-45fb-8ada-f7c50ff561e7"). InnerVolumeSpecName "kube-api-access-t2kqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:35:33.644546 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.644457    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94ad75eb-739e-45fb-8ada-f7c50ff561e7-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.644546 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.644490    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2kqc\" (UniqueName: \"kubernetes.io/projected/94ad75eb-739e-45fb-8ada-f7c50ff561e7-kube-api-access-t2kqc\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:35:33.754880 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.754854    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:35:33.765497 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:33.765473    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-119aafd2-6459bc57b5-mvshg"]
Sep 16 18:35:34.392165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:34.392079    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"
Sep 16 18:35:34.392165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:34.392101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt" event={"ID":"94ad75eb-739e-45fb-8ada-f7c50ff561e7","Type":"ContainerDied","Data":"8a3439e27d53df06e10934b19fd2ef1fde01242c7d86d271faa87c44aac4307c"}
Sep 16 18:35:34.392165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:34.392158    2565 scope.go:117] "RemoveContainer" containerID="0afa7716ffeba8d7440bec60e40e092e25ce83ee44e9d891d84b459f0fe7e93f"
Sep 16 18:35:34.472542 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:34.472505    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:35:34.511809 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:34.511776    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-119aafd2-749c6d5549-kxnwt"]
Sep 16 18:35:35.740649 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:35.740615    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" path="/var/lib/kubelet/pods/94ad75eb-739e-45fb-8ada-f7c50ff561e7/volumes"
Sep 16 18:35:35.741111 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:35.741092    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad787243-9294-488a-8b86-cef6af697270" path="/var/lib/kubelet/pods/ad787243-9294-488a-8b86-cef6af697270/volumes"
Sep 16 18:35:47.628864 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.628832    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:35:47.629383 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629363    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad787243-9294-488a-8b86-cef6af697270" containerName="maas-api"
Sep 16 18:35:47.629463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629386    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad787243-9294-488a-8b86-cef6af697270" containerName="maas-api"
Sep 16 18:35:47.629463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629420    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" containerName="payload-processing"
Sep 16 18:35:47.629463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629430    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" containerName="payload-processing"
Sep 16 18:35:47.629603 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629519    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad787243-9294-488a-8b86-cef6af697270" containerName="maas-api"
Sep 16 18:35:47.629603 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.629532    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="94ad75eb-739e-45fb-8ada-f7c50ff561e7" containerName="payload-processing"
Sep 16 18:35:47.634084 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.634056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.646815 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.646781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-ad2bfa56-serving-cert\""
Sep 16 18:35:47.672704 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.672675    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:35:47.771984 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.771951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.772164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.772010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.772164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.772027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5hdx\" (UniqueName: \"kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.772164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.772149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.873324 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.873280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.873516 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.873383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.873516 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.873460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.873642 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:35:47.873549    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-serving-cert: secret "maas-api-e2e-migrate-ad2bfa56-serving-cert" not found
Sep 16 18:35:47.873642 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.873593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5hdx\" (UniqueName: \"kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.873642 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:35:47.873629    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls podName:f8540833-1c00-4ae6-aff9-fb0724d3737c nodeName:}" failed. No retries permitted until 2026-09-16 18:35:48.37360569 +0000 UTC m=+1183.066047613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls") pod "maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c") : secret "maas-api-e2e-migrate-ad2bfa56-serving-cert" not found
Sep 16 18:35:47.874076 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.874050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.875931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.875905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:47.890568 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:47.890517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5hdx\" (UniqueName: \"kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:48.378835 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:48.378792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:48.379042 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:35:48.378956    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-serving-cert: secret "maas-api-e2e-migrate-ad2bfa56-serving-cert" not found
Sep 16 18:35:48.379042 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:35:48.379030    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls podName:f8540833-1c00-4ae6-aff9-fb0724d3737c nodeName:}" failed. No retries permitted until 2026-09-16 18:35:49.379014891 +0000 UTC m=+1184.071456811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls") pod "maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c") : secret "maas-api-e2e-migrate-ad2bfa56-serving-cert" not found
Sep 16 18:35:49.038262 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.038228    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:35:49.041871 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.041852    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.056165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.056142    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ad2bfa56\""
Sep 16 18:35:49.063631 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.063605    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:35:49.086185 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.086154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vszk\" (UniqueName: \"kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.086338 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.086318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.186740 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.186697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vszk\" (UniqueName: \"kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.186934 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.186818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.187488 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.187468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.203445 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.203370    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vszk\" (UniqueName: \"kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk\") pod \"payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.352954 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.352878    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:49.388827 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.388781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:49.391113 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.391084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:49.447853 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.447816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:49.653502 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.653476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:35:49.655383 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:35:49.655355    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2f224e_5ee4_4f22_aab0_178d91810a67.slice/crio-b3156bf3ff814d697f2d3a71660016a28e962f7185f2ec615e905a9f2c07804d WatchSource:0}: Error finding container b3156bf3ff814d697f2d3a71660016a28e962f7185f2ec615e905a9f2c07804d: Status 404 returned error can't find the container with id b3156bf3ff814d697f2d3a71660016a28e962f7185f2ec615e905a9f2c07804d
Sep 16 18:35:49.741728 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:35:49.741698    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8540833_1c00_4ae6_aff9_fb0724d3737c.slice/crio-f54c272f42c702287889af39fd9fad455c7702fe3b0a649c665bd8547a983904 WatchSource:0}: Error finding container f54c272f42c702287889af39fd9fad455c7702fe3b0a649c665bd8547a983904: Status 404 returned error can't find the container with id f54c272f42c702287889af39fd9fad455c7702fe3b0a649c665bd8547a983904
Sep 16 18:35:49.742046 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:49.742026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:35:50.472437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.472340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" event={"ID":"1a2f224e-5ee4-4f22-aab0-178d91810a67","Type":"ContainerStarted","Data":"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"}
Sep 16 18:35:50.472437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.472394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" event={"ID":"1a2f224e-5ee4-4f22-aab0-178d91810a67","Type":"ContainerStarted","Data":"b3156bf3ff814d697f2d3a71660016a28e962f7185f2ec615e905a9f2c07804d"}
Sep 16 18:35:50.472918 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.472461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:35:50.474071 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.474030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" event={"ID":"f8540833-1c00-4ae6-aff9-fb0724d3737c","Type":"ContainerStarted","Data":"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"}
Sep 16 18:35:50.474180 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.474078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" event={"ID":"f8540833-1c00-4ae6-aff9-fb0724d3737c","Type":"ContainerStarted","Data":"f54c272f42c702287889af39fd9fad455c7702fe3b0a649c665bd8547a983904"}
Sep 16 18:35:50.474180 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.474161    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:35:50.572809 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.572744    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" podStartSLOduration=3.196825645 podStartE2EDuration="3.572720622s" totalImagesPullingTime="375.894977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:35:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:35:50.570661347 +0000 UTC m=+1185.263103288" watchObservedRunningTime="2026-09-16 18:35:50.572720622 +0000 UTC m=+1185.265162572"
Sep 16 18:35:50.573577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:50.573546    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" podStartSLOduration=2.57353334 podStartE2EDuration="2.57353334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:35:50.52090326 +0000 UTC m=+1185.213345193" watchObservedRunningTime="2026-09-16 18:35:50.57353334 +0000 UTC m=+1185.265975285"
Sep 16 18:35:56.484503 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:35:56.484470    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:36:01.481268 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:01.481237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:36:25.094228 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.094195    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:36:25.094638 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.094430    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" podUID="f8540833-1c00-4ae6-aff9-fb0724d3737c" containerName="maas-api" containerID="cri-o://cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796" gracePeriod=30
Sep 16 18:36:25.234388 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.234346    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:36:25.234675 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.234642    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" podUID="1a2f224e-5ee4-4f22-aab0-178d91810a67" containerName="payload-pre-processing" containerID="cri-o://6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853" gracePeriod=30
Sep 16 18:36:25.365553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.365527    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:36:25.482741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.482713    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:36:25.520459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.520422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") pod \"f8540833-1c00-4ae6-aff9-fb0724d3737c\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") "
Sep 16 18:36:25.520459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.520468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca\") pod \"f8540833-1c00-4ae6-aff9-fb0724d3737c\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") "
Sep 16 18:36:25.520729 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.520521    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5hdx\" (UniqueName: \"kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx\") pod \"f8540833-1c00-4ae6-aff9-fb0724d3737c\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") "
Sep 16 18:36:25.520729 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.520561    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs\") pod \"f8540833-1c00-4ae6-aff9-fb0724d3737c\" (UID: \"f8540833-1c00-4ae6-aff9-fb0724d3737c\") "
Sep 16 18:36:25.520960 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.520909    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8540833-1c00-4ae6-aff9-fb0724d3737c" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:36:25.523169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.523144    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8540833-1c00-4ae6-aff9-fb0724d3737c" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:25.523351 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.523278    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8540833-1c00-4ae6-aff9-fb0724d3737c" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:25.523748 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.523713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx" (OuterVolumeSpecName: "kube-api-access-n5hdx") pod "f8540833-1c00-4ae6-aff9-fb0724d3737c" (UID: "f8540833-1c00-4ae6-aff9-fb0724d3737c"). InnerVolumeSpecName "kube-api-access-n5hdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:25.621756 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.621682    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume\") pod \"1a2f224e-5ee4-4f22-aab0-178d91810a67\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") "
Sep 16 18:36:25.621918 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.621833    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vszk\" (UniqueName: \"kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk\") pod \"1a2f224e-5ee4-4f22-aab0-178d91810a67\" (UID: \"1a2f224e-5ee4-4f22-aab0-178d91810a67\") "
Sep 16 18:36:25.622136 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622110    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a2f224e-5ee4-4f22-aab0-178d91810a67" (UID: "1a2f224e-5ee4-4f22-aab0-178d91810a67"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:36:25.622244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622179    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5hdx\" (UniqueName: \"kubernetes.io/projected/f8540833-1c00-4ae6-aff9-fb0724d3737c-kube-api-access-n5hdx\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.622244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622192    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a2f224e-5ee4-4f22-aab0-178d91810a67-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.622244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622206    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.622244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622216    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8540833-1c00-4ae6-aff9-fb0724d3737c-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.622244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.622225    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8540833-1c00-4ae6-aff9-fb0724d3737c-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.623811 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.623788    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk" (OuterVolumeSpecName: "kube-api-access-9vszk") pod "1a2f224e-5ee4-4f22-aab0-178d91810a67" (UID: "1a2f224e-5ee4-4f22-aab0-178d91810a67"). InnerVolumeSpecName "kube-api-access-9vszk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:25.637026 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.636992    2565 generic.go:356] "Generic (PLEG): container finished" podID="1a2f224e-5ee4-4f22-aab0-178d91810a67" containerID="6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853" exitCode=0
Sep 16 18:36:25.637171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.637040    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"
Sep 16 18:36:25.637171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.637081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" event={"ID":"1a2f224e-5ee4-4f22-aab0-178d91810a67","Type":"ContainerDied","Data":"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"}
Sep 16 18:36:25.637171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.637140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59" event={"ID":"1a2f224e-5ee4-4f22-aab0-178d91810a67","Type":"ContainerDied","Data":"b3156bf3ff814d697f2d3a71660016a28e962f7185f2ec615e905a9f2c07804d"}
Sep 16 18:36:25.637340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.637173    2565 scope.go:117] "RemoveContainer" containerID="6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"
Sep 16 18:36:25.638397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.638362    2565 generic.go:356] "Generic (PLEG): container finished" podID="f8540833-1c00-4ae6-aff9-fb0724d3737c" containerID="cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796" exitCode=0
Sep 16 18:36:25.638468 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.638402    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"
Sep 16 18:36:25.638468 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.638418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" event={"ID":"f8540833-1c00-4ae6-aff9-fb0724d3737c","Type":"ContainerDied","Data":"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"}
Sep 16 18:36:25.638541 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.638476    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp" event={"ID":"f8540833-1c00-4ae6-aff9-fb0724d3737c","Type":"ContainerDied","Data":"f54c272f42c702287889af39fd9fad455c7702fe3b0a649c665bd8547a983904"}
Sep 16 18:36:25.646909 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.646873    2565 scope.go:117] "RemoveContainer" containerID="6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"
Sep 16 18:36:25.647215 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:36:25.647187    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853\": container with ID starting with 6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853 not found: ID does not exist" containerID="6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"
Sep 16 18:36:25.647329 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.647225    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853"} err="failed to get container status \"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853\": rpc error: code = NotFound desc = could not find container \"6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853\": container with ID starting with 6d7646ae10b0df740839738daf44fa10b8f17ea101803f1c6379d878c5d65853 not found: ID does not exist"
Sep 16 18:36:25.647329 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.647251    2565 scope.go:117] "RemoveContainer" containerID="cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"
Sep 16 18:36:25.655664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.655641    2565 scope.go:117] "RemoveContainer" containerID="cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"
Sep 16 18:36:25.655959 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:36:25.655941    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796\": container with ID starting with cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796 not found: ID does not exist" containerID="cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"
Sep 16 18:36:25.656021 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.655967    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796"} err="failed to get container status \"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796\": rpc error: code = NotFound desc = could not find container \"cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796\": container with ID starting with cb50b32b9580ca8f3e171695cb50b69279685fb3d99435a5846fb62aac723796 not found: ID does not exist"
Sep 16 18:36:25.675099 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.675073    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:36:25.681539 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.681520    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad2bfa56-5584876d7d-tbvnp"]
Sep 16 18:36:25.723291 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.723260    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vszk\" (UniqueName: \"kubernetes.io/projected/1a2f224e-5ee4-4f22-aab0-178d91810a67-kube-api-access-9vszk\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:25.732048 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.732018    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:36:25.740035 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.740005    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8540833-1c00-4ae6-aff9-fb0724d3737c" path="/var/lib/kubelet/pods/f8540833-1c00-4ae6-aff9-fb0724d3737c/volumes"
Sep 16 18:36:25.744819 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:25.744796    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ad2bfa56-6d7784cc94-s7x59"]
Sep 16 18:36:27.001694 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.001658    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:36:27.002117 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002103    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2f224e-5ee4-4f22-aab0-178d91810a67" containerName="payload-pre-processing"
Sep 16 18:36:27.002157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002119    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2f224e-5ee4-4f22-aab0-178d91810a67" containerName="payload-pre-processing"
Sep 16 18:36:27.002157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002144    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8540833-1c00-4ae6-aff9-fb0724d3737c" containerName="maas-api"
Sep 16 18:36:27.002157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002149    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8540833-1c00-4ae6-aff9-fb0724d3737c" containerName="maas-api"
Sep 16 18:36:27.002248 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002214    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2f224e-5ee4-4f22-aab0-178d91810a67" containerName="payload-pre-processing"
Sep 16 18:36:27.002248 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.002224    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8540833-1c00-4ae6-aff9-fb0724d3737c" containerName="maas-api"
Sep 16 18:36:27.006902 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.006871    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.012323 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.012265    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-019b7d43-openshift-default-dockercfg-nw7dq\""
Sep 16 18:36:27.043244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.043206    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:36:27.137416 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137648 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137682 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137717 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdghb\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.137814 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.137770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.238913 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.238857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239075 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.238966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239075 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239075 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239034    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239075 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdghb\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239457 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239672 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239778 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.239836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.239817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.241680 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.241658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.241756 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.241684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.261386 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.261325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.261484 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.261462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdghb\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb\") pod \"e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") " pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.317276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.317239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:27.630120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.630095    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:36:27.632340 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:36:27.632312    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495290f3_9832_48c1_bafd_53674bb8f202.slice/crio-62f0492548753392fe6b93913eea642e8b57556d02a059657d6b891b5089505c WatchSource:0}: Error finding container 62f0492548753392fe6b93913eea642e8b57556d02a059657d6b891b5089505c: Status 404 returned error can't find the container with id 62f0492548753392fe6b93913eea642e8b57556d02a059657d6b891b5089505c
Sep 16 18:36:27.650936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.650880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerStarted","Data":"62f0492548753392fe6b93913eea642e8b57556d02a059657d6b891b5089505c"}
Sep 16 18:36:27.740825 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:27.740791    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2f224e-5ee4-4f22-aab0-178d91810a67" path="/var/lib/kubelet/pods/1a2f224e-5ee4-4f22-aab0-178d91810a67/volumes"
Sep 16 18:36:40.007686 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:40.007646    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:40.007995 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:40.007724    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:40.007995 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:40.007751    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:36:40.714489 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:40.714451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerStarted","Data":"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"}
Sep 16 18:36:41.317672 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:41.317634    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:41.322879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:41.322849    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:41.350396 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:41.350342    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podStartSLOduration=2.9774487130000002 podStartE2EDuration="15.350325305s" totalImagesPullingTime="12.372876592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:36:40.742438129 +0000 UTC m=+1235.434880071" watchObservedRunningTime="2026-09-16 18:36:41.350325305 +0000 UTC m=+1236.042767247"
Sep 16 18:36:41.718782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:41.718703    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:41.719570 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:41.719553    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:36:46.602476 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.602442    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:36:46.606256 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.606234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.621618 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.621591    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-019b7d43-serving-cert\""
Sep 16 18:36:46.631852 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.631823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:36:46.721254 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.721219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.721437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.721269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.721437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.721296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmc8\" (UniqueName: \"kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.721437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.721327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.822141 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.822101    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.822334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.822172    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.822334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.822198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmc8\" (UniqueName: \"kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.822334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.822215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.822857 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.822829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.824733 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.824712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.824916 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.824874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.835429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.835396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmc8\" (UniqueName: \"kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8\") pod \"maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:46.916485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:46.916405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:47.201969 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:47.201943    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:36:47.204544 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:36:47.204517    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c40bad8_f4f3_4ec9_a0ea_eff7d80031b2.slice/crio-79aa8a91372b2a49c81e34dec12c5bbe2a74b483b5d26295248ee9c26555f1b7 WatchSource:0}: Error finding container 79aa8a91372b2a49c81e34dec12c5bbe2a74b483b5d26295248ee9c26555f1b7: Status 404 returned error can't find the container with id 79aa8a91372b2a49c81e34dec12c5bbe2a74b483b5d26295248ee9c26555f1b7
Sep 16 18:36:47.747962 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:47.747930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" event={"ID":"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2","Type":"ContainerStarted","Data":"79aa8a91372b2a49c81e34dec12c5bbe2a74b483b5d26295248ee9c26555f1b7"}
Sep 16 18:36:48.754256 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:48.754208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" event={"ID":"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2","Type":"ContainerStarted","Data":"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"}
Sep 16 18:36:48.754651 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:48.754281    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:36:48.783065 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:48.783013    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" podStartSLOduration=2.275756901 podStartE2EDuration="2.782995972s" totalImagesPullingTime="507.239071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:36:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:36:48.780979634 +0000 UTC m=+1243.473421575" watchObservedRunningTime="2026-09-16 18:36:48.782995972 +0000 UTC m=+1243.475437911"
Sep 16 18:36:50.520882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.520847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:36:50.521583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.521086    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" podUID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" containerName="maas-api" containerID="cri-o://605a1cd3cb3ba1c2c6d9e92a2f869e7af1d80af3a038520a2e8d319dba3fb09c" gracePeriod=30
Sep 16 18:36:50.767532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.767497    2565 generic.go:356] "Generic (PLEG): container finished" podID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" containerID="605a1cd3cb3ba1c2c6d9e92a2f869e7af1d80af3a038520a2e8d319dba3fb09c" exitCode=0
Sep 16 18:36:50.767700 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.767561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" event={"ID":"18947c1d-dd0c-4462-a3c6-f56cfe2e5031","Type":"ContainerDied","Data":"605a1cd3cb3ba1c2c6d9e92a2f869e7af1d80af3a038520a2e8d319dba3fb09c"}
Sep 16 18:36:50.767700 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.767617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh" event={"ID":"18947c1d-dd0c-4462-a3c6-f56cfe2e5031","Type":"ContainerDied","Data":"cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2"}
Sep 16 18:36:50.767700 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.767638    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc75ab4c4480d51519c1ae628d496f59846080ecab5488e699b1beca987d88c2"
Sep 16 18:36:50.771420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.771354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:36:50.860999 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.860962    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls\") pod \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") "
Sep 16 18:36:50.861211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.861028    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs\") pod \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") "
Sep 16 18:36:50.861211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.861057    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca\") pod \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") "
Sep 16 18:36:50.861211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.861078    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46m74\" (UniqueName: \"kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74\") pod \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\" (UID: \"18947c1d-dd0c-4462-a3c6-f56cfe2e5031\") "
Sep 16 18:36:50.861568 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.861524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18947c1d-dd0c-4462-a3c6-f56cfe2e5031" (UID: "18947c1d-dd0c-4462-a3c6-f56cfe2e5031"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:36:50.863615 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.863580    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18947c1d-dd0c-4462-a3c6-f56cfe2e5031" (UID: "18947c1d-dd0c-4462-a3c6-f56cfe2e5031"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:50.863739 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.863635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74" (OuterVolumeSpecName: "kube-api-access-46m74") pod "18947c1d-dd0c-4462-a3c6-f56cfe2e5031" (UID: "18947c1d-dd0c-4462-a3c6-f56cfe2e5031"). InnerVolumeSpecName "kube-api-access-46m74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:36:50.863739 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.863724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "18947c1d-dd0c-4462-a3c6-f56cfe2e5031" (UID: "18947c1d-dd0c-4462-a3c6-f56cfe2e5031"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:36:50.962741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.962706    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:50.962741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.962735    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:50.962741 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.962745    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:50.963017 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:50.962755    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46m74\" (UniqueName: \"kubernetes.io/projected/18947c1d-dd0c-4462-a3c6-f56cfe2e5031-kube-api-access-46m74\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:36:51.772739 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:51.772704    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"
Sep 16 18:36:51.800708 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:51.800665    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:36:51.807972 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:51.807937    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b875d-5d64c9848f-l77xh"]
Sep 16 18:36:53.740773 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:53.740738    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" path="/var/lib/kubelet/pods/18947c1d-dd0c-4462-a3c6-f56cfe2e5031/volumes"
Sep 16 18:36:54.765046 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:36:54.765015    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:37:06.852006 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.851973    2565 generic.go:356] "Generic (PLEG): container finished" podID="495290f3-9832-48c1-bafd-53674bb8f202" containerID="926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97" exitCode=0
Sep 16 18:37:06.852413 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.852045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerDied","Data":"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"}
Sep 16 18:37:06.852459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.852432    2565 scope.go:117] "RemoveContainer" containerID="926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"
Sep 16 18:37:06.853538 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.853509    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:06.853611 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.853582    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:06.853650 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:06.853621    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:07.865294 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:07.865252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerStarted","Data":"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"}
Sep 16 18:37:08.318147 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:08.318101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:08.319343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:08.319316    2565 patch_prober.go:28] interesting pod/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:37:08.319529 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:08.319380    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 18:37:09.318572 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:09.318536    2565 patch_prober.go:28] interesting pod/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:37:09.318996 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:09.318605    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 18:37:10.318258 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:10.318212    2565 patch_prober.go:28] interesting pod/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:37:10.318520 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:10.318283    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 18:37:11.317990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:11.317952    2565 patch_prober.go:28] interesting pod/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:37:11.318468 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:11.318016    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 18:37:11.719562 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:11.719451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:12.318597 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:12.318560    2565 patch_prober.go:28] interesting pod/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 16 18:37:12.319031 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:12.318623    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 16 18:37:13.497461 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:13.497427    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:13.500987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:13.500921    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:20.145873 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.145841    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:37:20.146284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.146269    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" containerName="maas-api"
Sep 16 18:37:20.146329 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.146287    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" containerName="maas-api"
Sep 16 18:37:20.146363 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.146344    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="18947c1d-dd0c-4462-a3c6-f56cfe2e5031" containerName="maas-api"
Sep 16 18:37:20.154103 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.154081    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.157450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.157428    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-efa70c-openshift-default-dockercfg-4d9n5\""
Sep 16 18:37:20.165826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.165496    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:37:20.264278 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np2mw\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264278 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264554 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264554 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264554 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264554 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264554 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264822 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.264822 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.264587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365368 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np2mw\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365368 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365465    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365614    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.365879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.366025 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.365924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.366148 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.366122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.366235 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.366211    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.366294 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.366217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.366386 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.366366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.368086 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.368063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.368209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.368154    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.374483 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.374460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.374622 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.374598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np2mw\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw\") pod \"e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") " pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.466051 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.465953    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:20.750912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.750873    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:37:20.753000 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:37:20.752968    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb8bb1d_bddd_4d9c_b42c_4a41a9c10c11.slice/crio-670904c1683cf439bfa3e7b75d552c9adfc66de8664ed9700fa78e595621170f WatchSource:0}: Error finding container 670904c1683cf439bfa3e7b75d552c9adfc66de8664ed9700fa78e595621170f: Status 404 returned error can't find the container with id 670904c1683cf439bfa3e7b75d552c9adfc66de8664ed9700fa78e595621170f
Sep 16 18:37:20.755156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.755120    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:20.755242 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.755190    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:20.755242 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.755218    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:20.929533 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.929493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerStarted","Data":"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"}
Sep 16 18:37:20.929723 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.929558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerStarted","Data":"670904c1683cf439bfa3e7b75d552c9adfc66de8664ed9700fa78e595621170f"}
Sep 16 18:37:20.956255 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:20.956195    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podStartSLOduration=0.956174147 podStartE2EDuration="956.174147ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:20.954146645 +0000 UTC m=+1275.646588591" watchObservedRunningTime="2026-09-16 18:37:20.956174147 +0000 UTC m=+1275.648616090"
Sep 16 18:37:21.467168 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:21.467125    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:21.472522 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:21.472491    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:21.934662 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:21.934631    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:21.935776 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:21.935754    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:26.889022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:26.888991    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:37:26.889800 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:26.889216    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" podUID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" containerName="maas-api" containerID="cri-o://493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb" gracePeriod=30
Sep 16 18:37:27.140343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.140285    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:37:27.229365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.229331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs\") pod \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") "
Sep 16 18:37:27.229547 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.229380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls\") pod \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") "
Sep 16 18:37:27.229547 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.229431    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqmc8\" (UniqueName: \"kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8\") pod \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") "
Sep 16 18:37:27.229547 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.229466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca\") pod \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\" (UID: \"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2\") "
Sep 16 18:37:27.229946 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.229888    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" (UID: "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:37:27.231481 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.231453    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" (UID: "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:37:27.231594 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.231488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" (UID: "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:37:27.231662 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.231628    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8" (OuterVolumeSpecName: "kube-api-access-mqmc8") pod "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" (UID: "3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2"). InnerVolumeSpecName "kube-api-access-mqmc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:27.330417 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.330387    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:27.330417 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.330414    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqmc8\" (UniqueName: \"kubernetes.io/projected/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-kube-api-access-mqmc8\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:27.330417 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.330425    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:27.330651 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.330434    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:27.970453 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.970418    2565 generic.go:356] "Generic (PLEG): container finished" podID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" containerID="493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb" exitCode=0
Sep 16 18:37:27.970945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.970471    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"
Sep 16 18:37:27.970945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.970490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" event={"ID":"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2","Type":"ContainerDied","Data":"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"}
Sep 16 18:37:27.970945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.970537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2" event={"ID":"3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2","Type":"ContainerDied","Data":"79aa8a91372b2a49c81e34dec12c5bbe2a74b483b5d26295248ee9c26555f1b7"}
Sep 16 18:37:27.970945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.970561    2565 scope.go:117] "RemoveContainer" containerID="493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"
Sep 16 18:37:27.979819 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.979800    2565 scope.go:117] "RemoveContainer" containerID="493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"
Sep 16 18:37:27.980141 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:37:27.980119    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb\": container with ID starting with 493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb not found: ID does not exist" containerID="493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"
Sep 16 18:37:27.980199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.980149    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb"} err="failed to get container status \"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb\": rpc error: code = NotFound desc = could not find container \"493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb\": container with ID starting with 493e555cb7880fc79830b256500cd25766a1d645b11cc370cf45d7b1107c9efb not found: ID does not exist"
Sep 16 18:37:27.993956 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.993925    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:37:27.999206 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:27.999181    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-019b7d43-645c7b4d7b-fjfb2"]
Sep 16 18:37:28.415521 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.415482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:37:28.415958 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.415940    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" containerName="maas-api"
Sep 16 18:37:28.416054 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.415959    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" containerName="maas-api"
Sep 16 18:37:28.416113 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.416084    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" containerName="maas-api"
Sep 16 18:37:28.420436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.420414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.423164 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.423140    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-efa70c\""
Sep 16 18:37:28.423268 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.423251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-efa70c-dockercfg-tnvr5\""
Sep 16 18:37:28.444584 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.444560    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:37:28.543278 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.543240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.543453 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.543390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgkb\" (UniqueName: \"kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.644810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.644779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgkb\" (UniqueName: \"kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.645008 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.644834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.645535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.645511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.659694 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.659673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vgkb\" (UniqueName: \"kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb\") pod \"payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:28.728643 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.728555    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:37:28.728865 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.728796    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy" containerID="cri-o://f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0" gracePeriod=30
Sep 16 18:37:28.730460 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:28.730430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:29.009332 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:29.009010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:37:29.011883 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:37:29.011856    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83c6c12_b8cb_429f_983e_9f9d6e97abc7.slice/crio-4f4d80c3ba41ca4a1bce22ad56be96baf80fd6ede17a0c0d73518b91c49868e9 WatchSource:0}: Error finding container 4f4d80c3ba41ca4a1bce22ad56be96baf80fd6ede17a0c0d73518b91c49868e9: Status 404 returned error can't find the container with id 4f4d80c3ba41ca4a1bce22ad56be96baf80fd6ede17a0c0d73518b91c49868e9
Sep 16 18:37:29.740337 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:29.740303    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2" path="/var/lib/kubelet/pods/3c40bad8-f4f3-4ec9-a0ea-eff7d80031b2/volumes"
Sep 16 18:37:29.981984 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:29.981950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" event={"ID":"b83c6c12-b8cb-429f-983e-9f9d6e97abc7","Type":"ContainerStarted","Data":"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"}
Sep 16 18:37:29.982160 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:29.982007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" event={"ID":"b83c6c12-b8cb-429f-983e-9f9d6e97abc7","Type":"ContainerStarted","Data":"4f4d80c3ba41ca4a1bce22ad56be96baf80fd6ede17a0c0d73518b91c49868e9"}
Sep 16 18:37:29.982160 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:29.982121    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:30.004835 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:30.004730    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" podStartSLOduration=2.004715016 podStartE2EDuration="2.004715016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:30.003462886 +0000 UTC m=+1284.695904828" watchObservedRunningTime="2026-09-16 18:37:30.004715016 +0000 UTC m=+1284.697156958"
Sep 16 18:37:33.974601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:33.974573    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:34.005775 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.005688    2565 generic.go:356] "Generic (PLEG): container finished" podID="495290f3-9832-48c1-bafd-53674bb8f202" containerID="f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0" exitCode=0
Sep 16 18:37:34.005775 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.005736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerDied","Data":"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"}
Sep 16 18:37:34.005775 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.005754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"
Sep 16 18:37:34.006058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.005778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn" event={"ID":"495290f3-9832-48c1-bafd-53674bb8f202","Type":"ContainerDied","Data":"62f0492548753392fe6b93913eea642e8b57556d02a059657d6b891b5089505c"}
Sep 16 18:37:34.006058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.005805    2565 scope.go:117] "RemoveContainer" containerID="f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"
Sep 16 18:37:34.015790 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.015772    2565 scope.go:117] "RemoveContainer" containerID="926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"
Sep 16 18:37:34.024963 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.024908    2565 scope.go:117] "RemoveContainer" containerID="f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"
Sep 16 18:37:34.025311 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:37:34.025276    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0\": container with ID starting with f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0 not found: ID does not exist" containerID="f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"
Sep 16 18:37:34.025420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.025322    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0"} err="failed to get container status \"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0\": rpc error: code = NotFound desc = could not find container \"f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0\": container with ID starting with f5d8909842c6ca113291a2556f1618954e97ccfea6dc33e9a79e31f1ca1fbea0 not found: ID does not exist"
Sep 16 18:37:34.025420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.025348    2565 scope.go:117] "RemoveContainer" containerID="926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"
Sep 16 18:37:34.025694 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:37:34.025661    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97\": container with ID starting with 926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97 not found: ID does not exist" containerID="926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"
Sep 16 18:37:34.025762 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.025705    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97"} err="failed to get container status \"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97\": rpc error: code = NotFound desc = could not find container \"926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97\": container with ID starting with 926b81324210ab4483d05efa905eb034b997ef37e8e145754ed6f56ae52c0f97 not found: ID does not exist"
Sep 16 18:37:34.098523 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098567    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098627    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdghb\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098686    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.098722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.099058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098748    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.099058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data\") pod \"495290f3-9832-48c1-bafd-53674bb8f202\" (UID: \"495290f3-9832-48c1-bafd-53674bb8f202\") "
Sep 16 18:37:34.099058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.098938    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:34.099058 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:34.099247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:37:34.099247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099137    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:34.099247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099212    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data" (OuterVolumeSpecName: "istio-data") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:34.099395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099312    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.099395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099328    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.099395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099340    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.099395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099353    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.099395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.099368    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/495290f3-9832-48c1-bafd-53674bb8f202-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.101013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.100986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:37:34.101133 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.101031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:37:34.101291 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.101273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token" (OuterVolumeSpecName: "istio-token") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:34.101352 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.101333    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb" (OuterVolumeSpecName: "kube-api-access-xdghb") pod "495290f3-9832-48c1-bafd-53674bb8f202" (UID: "495290f3-9832-48c1-bafd-53674bb8f202"). InnerVolumeSpecName "kube-api-access-xdghb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:37:34.200348 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.200303    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/495290f3-9832-48c1-bafd-53674bb8f202-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.200526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.200374    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.200526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.200389    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/495290f3-9832-48c1-bafd-53674bb8f202-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.200526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.200433    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdghb\" (UniqueName: \"kubernetes.io/projected/495290f3-9832-48c1-bafd-53674bb8f202-kube-api-access-xdghb\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:37:34.335689 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.335656    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:37:34.347795 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.347768    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-019b7d43-openshift-default-7d979df69b-4hzrn"]
Sep 16 18:37:34.917657 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.917612    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:37:34.918242 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.918219    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:34.918242 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.918240    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:34.918420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.918257    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:34.918420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.918267    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:34.918420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.918344    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:34.921996 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.921859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:34.926649 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.926626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-b95e3be6-serving-cert\""
Sep 16 18:37:34.934378 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:34.934354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:37:35.007182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.007149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.007595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.007199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.007595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.007298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnwvb\" (UniqueName: \"kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.007595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.007331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.108209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.108175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnwvb\" (UniqueName: \"kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.108209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.108217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.108420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.108277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.108420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.108298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.108420 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:37:35.108406    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-serving-cert: secret "maas-api-e2e-derive-b95e3be6-serving-cert" not found
Sep 16 18:37:35.108542 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:37:35.108470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls podName:307b1b3b-98e9-490c-b304-ab3cddb6663b nodeName:}" failed. No retries permitted until 2026-09-16 18:37:35.608452482 +0000 UTC m=+1290.300894418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls") pod "maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" (UID: "307b1b3b-98e9-490c-b304-ab3cddb6663b") : secret "maas-api-e2e-derive-b95e3be6-serving-cert" not found
Sep 16 18:37:35.109045 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.109020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.110859 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.110835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.119429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.119400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnwvb\" (UniqueName: \"kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.613209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.613157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.615557 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.615528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") pod \"maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.740629 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.740597    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="495290f3-9832-48c1-bafd-53674bb8f202" path="/var/lib/kubelet/pods/495290f3-9832-48c1-bafd-53674bb8f202/volumes"
Sep 16 18:37:35.774270 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.774070    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:37:35.775096 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.775071    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="495290f3-9832-48c1-bafd-53674bb8f202" containerName="istio-proxy"
Sep 16 18:37:35.779692 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.779668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:35.782912 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.782866    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b95e3be6-dockercfg-mtfjp\""
Sep 16 18:37:35.783347 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.783325    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b95e3be6\""
Sep 16 18:37:35.792304 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.792279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:37:35.833710 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.833673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:35.917746 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.917655    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:35.917933 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:35.917775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkwkv\" (UniqueName: \"kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.018665 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.018627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.018665 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.018662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkwkv\" (UniqueName: \"kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.019390 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.019365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.031090 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.031061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkwkv\" (UniqueName: \"kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv\") pod \"payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.091178 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.091147    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:36.124208 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.124178    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:37:36.127434 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:37:36.127386    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307b1b3b_98e9_490c_b304_ab3cddb6663b.slice/crio-c7d95b554860f44475d3fce95bd256e53b35f5250b2304d88236f67a03e396b5 WatchSource:0}: Error finding container c7d95b554860f44475d3fce95bd256e53b35f5250b2304d88236f67a03e396b5: Status 404 returned error can't find the container with id c7d95b554860f44475d3fce95bd256e53b35f5250b2304d88236f67a03e396b5
Sep 16 18:37:36.128930 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.128873    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:37:36.388575 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:36.388518    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:37:36.390697 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:37:36.390670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f84e938_4bba_4cba_9535_e2dfb67b126f.slice/crio-8c2e42f73fdadc84959bf06b122dac2ffdaa2e61063bf293ef8ae0b88bb7cbab WatchSource:0}: Error finding container 8c2e42f73fdadc84959bf06b122dac2ffdaa2e61063bf293ef8ae0b88bb7cbab: Status 404 returned error can't find the container with id 8c2e42f73fdadc84959bf06b122dac2ffdaa2e61063bf293ef8ae0b88bb7cbab
Sep 16 18:37:37.024602 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.024512    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" event={"ID":"307b1b3b-98e9-490c-b304-ab3cddb6663b","Type":"ContainerStarted","Data":"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"}
Sep 16 18:37:37.024602 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.024572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:37.024602 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.024593    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" event={"ID":"307b1b3b-98e9-490c-b304-ab3cddb6663b","Type":"ContainerStarted","Data":"c7d95b554860f44475d3fce95bd256e53b35f5250b2304d88236f67a03e396b5"}
Sep 16 18:37:37.026151 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.026122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" event={"ID":"4f84e938-4bba-4cba-9535-e2dfb67b126f","Type":"ContainerStarted","Data":"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"}
Sep 16 18:37:37.026263 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.026167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" event={"ID":"4f84e938-4bba-4cba-9535-e2dfb67b126f","Type":"ContainerStarted","Data":"8c2e42f73fdadc84959bf06b122dac2ffdaa2e61063bf293ef8ae0b88bb7cbab"}
Sep 16 18:37:37.026263 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.026187    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:37.051207 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.051160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" podStartSLOduration=2.457472347 podStartE2EDuration="3.051146474s" totalImagesPullingTime="593.674127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:37.049138775 +0000 UTC m=+1291.741580719" watchObservedRunningTime="2026-09-16 18:37:37.051146474 +0000 UTC m=+1291.743588415"
Sep 16 18:37:37.092365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:37.092312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" podStartSLOduration=2.092295556 podStartE2EDuration="2.092295556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:37:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:37:37.091833223 +0000 UTC m=+1291.784275166" watchObservedRunningTime="2026-09-16 18:37:37.092295556 +0000 UTC m=+1291.784737498"
Sep 16 18:37:40.990469 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:40.990440    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:37:43.036284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:43.036253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:37:48.033561 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:48.033525    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:37:50.101251 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.101174    2565 generic.go:356] "Generic (PLEG): container finished" podID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerID="0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef" exitCode=0
Sep 16 18:37:50.101624 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.101246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerDied","Data":"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"}
Sep 16 18:37:50.101669 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.101627    2565 scope.go:117] "RemoveContainer" containerID="0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"
Sep 16 18:37:50.102772 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.102741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:50.102826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.102814    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:50.102861 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:50.102846    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:37:51.107991 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:51.107960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerStarted","Data":"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"}
Sep 16 18:37:51.466828 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:51.466726    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:51.467920 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:51.467869    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:51.468029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:51.467949    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:51.934646 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:51.934608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:52.466973 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:52.466931    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:52.467595 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:52.467556    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:53.467207 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:53.467164    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:53.467782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:53.467748    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:54.466985 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:54.466946    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:54.467695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:54.467269    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:55.467407 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:55.467364    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:55.467697 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:55.467661    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:56.467040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:56.467003    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:56.467616 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:56.467583    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:57.466722 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:57.466681    2565 patch_prober.go:28] interesting pod/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Sep 16 18:37:57.466961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:57.466746    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Sep 16 18:37:58.471041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:58.471005    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:37:58.471840 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:37:58.471823    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:38:03.364296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.364260    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:38:03.364760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.364512    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" podUID="307b1b3b-98e9-490c-b304-ab3cddb6663b" containerName="maas-api" containerID="cri-o://c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572" gracePeriod=30
Sep 16 18:38:03.447757 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.447725    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:38:03.447963 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.447939    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" podUID="4f84e938-4bba-4cba-9535-e2dfb67b126f" containerName="payload-pre-processing" containerID="cri-o://4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905" gracePeriod=30
Sep 16 18:38:03.705663 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.705635    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:38:03.732169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.732143    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:38:03.782229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") pod \"307b1b3b-98e9-490c-b304-ab3cddb6663b\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") "
Sep 16 18:38:03.782397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume\") pod \"4f84e938-4bba-4cba-9535-e2dfb67b126f\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") "
Sep 16 18:38:03.782397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca\") pod \"307b1b3b-98e9-490c-b304-ab3cddb6663b\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") "
Sep 16 18:38:03.782397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782324    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkwkv\" (UniqueName: \"kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv\") pod \"4f84e938-4bba-4cba-9535-e2dfb67b126f\" (UID: \"4f84e938-4bba-4cba-9535-e2dfb67b126f\") "
Sep 16 18:38:03.782397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782392    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs\") pod \"307b1b3b-98e9-490c-b304-ab3cddb6663b\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") "
Sep 16 18:38:03.782592 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnwvb\" (UniqueName: \"kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb\") pod \"307b1b3b-98e9-490c-b304-ab3cddb6663b\" (UID: \"307b1b3b-98e9-490c-b304-ab3cddb6663b\") "
Sep 16 18:38:03.782700 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "307b1b3b-98e9-490c-b304-ab3cddb6663b" (UID: "307b1b3b-98e9-490c-b304-ab3cddb6663b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:38:03.782774 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.782692    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f84e938-4bba-4cba-9535-e2dfb67b126f" (UID: "4f84e938-4bba-4cba-9535-e2dfb67b126f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:38:03.784484 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.784458    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "307b1b3b-98e9-490c-b304-ab3cddb6663b" (UID: "307b1b3b-98e9-490c-b304-ab3cddb6663b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:38:03.784606 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.784581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv" (OuterVolumeSpecName: "kube-api-access-pkwkv") pod "4f84e938-4bba-4cba-9535-e2dfb67b126f" (UID: "4f84e938-4bba-4cba-9535-e2dfb67b126f"). InnerVolumeSpecName "kube-api-access-pkwkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:38:03.784671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.784591    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "307b1b3b-98e9-490c-b304-ab3cddb6663b" (UID: "307b1b3b-98e9-490c-b304-ab3cddb6663b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:38:03.784671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.784618    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb" (OuterVolumeSpecName: "kube-api-access-tnwvb") pod "307b1b3b-98e9-490c-b304-ab3cddb6663b" (UID: "307b1b3b-98e9-490c-b304-ab3cddb6663b"). InnerVolumeSpecName "kube-api-access-tnwvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:38:03.883787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883752    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:03.883787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883784    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f84e938-4bba-4cba-9535-e2dfb67b126f-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:03.883787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883795    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/307b1b3b-98e9-490c-b304-ab3cddb6663b-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:03.884044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883804    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkwkv\" (UniqueName: \"kubernetes.io/projected/4f84e938-4bba-4cba-9535-e2dfb67b126f-kube-api-access-pkwkv\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:03.884044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883815    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/307b1b3b-98e9-490c-b304-ab3cddb6663b-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:03.884044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:03.883824    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnwvb\" (UniqueName: \"kubernetes.io/projected/307b1b3b-98e9-490c-b304-ab3cddb6663b-kube-api-access-tnwvb\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:38:04.179603 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.179570    2565 generic.go:356] "Generic (PLEG): container finished" podID="307b1b3b-98e9-490c-b304-ab3cddb6663b" containerID="c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572" exitCode=0
Sep 16 18:38:04.179785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.179626    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"
Sep 16 18:38:04.179785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.179662    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" event={"ID":"307b1b3b-98e9-490c-b304-ab3cddb6663b","Type":"ContainerDied","Data":"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"}
Sep 16 18:38:04.179785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.179757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz" event={"ID":"307b1b3b-98e9-490c-b304-ab3cddb6663b","Type":"ContainerDied","Data":"c7d95b554860f44475d3fce95bd256e53b35f5250b2304d88236f67a03e396b5"}
Sep 16 18:38:04.179984 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.179786    2565 scope.go:117] "RemoveContainer" containerID="c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"
Sep 16 18:38:04.181305 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.181282    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f84e938-4bba-4cba-9535-e2dfb67b126f" containerID="4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905" exitCode=0
Sep 16 18:38:04.181403 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.181335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" event={"ID":"4f84e938-4bba-4cba-9535-e2dfb67b126f","Type":"ContainerDied","Data":"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"}
Sep 16 18:38:04.181403 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.181357    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"
Sep 16 18:38:04.181403 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.181375    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4" event={"ID":"4f84e938-4bba-4cba-9535-e2dfb67b126f","Type":"ContainerDied","Data":"8c2e42f73fdadc84959bf06b122dac2ffdaa2e61063bf293ef8ae0b88bb7cbab"}
Sep 16 18:38:04.190971 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.190948    2565 scope.go:117] "RemoveContainer" containerID="c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"
Sep 16 18:38:04.191229 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:38:04.191209    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572\": container with ID starting with c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572 not found: ID does not exist" containerID="c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"
Sep 16 18:38:04.191309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.191242    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572"} err="failed to get container status \"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572\": rpc error: code = NotFound desc = could not find container \"c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572\": container with ID starting with c6080f36f60d02357d0bd8ff42c86577c956b174f5b9cf34bb4433eaa926a572 not found: ID does not exist"
Sep 16 18:38:04.191309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.191264    2565 scope.go:117] "RemoveContainer" containerID="4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"
Sep 16 18:38:04.199834 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.199810    2565 scope.go:117] "RemoveContainer" containerID="4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"
Sep 16 18:38:04.200167 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:38:04.200148    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905\": container with ID starting with 4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905 not found: ID does not exist" containerID="4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"
Sep 16 18:38:04.200266 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.200173    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905"} err="failed to get container status \"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905\": rpc error: code = NotFound desc = could not find container \"4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905\": container with ID starting with 4d09cd0e49c09821bdae2055aee9031a002050776da6a5c8e80e358e68403905 not found: ID does not exist"
Sep 16 18:38:04.211776 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.211752    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:38:04.218250 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.218228    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-b95e3be6-5dddc97c66-tlgqz"]
Sep 16 18:38:04.245301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.245277    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:38:04.268757 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:04.268726    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-b95e3be6-5997c7ddc8-n5bs4"]
Sep 16 18:38:05.741859 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:05.741824    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307b1b3b-98e9-490c-b304-ab3cddb6663b" path="/var/lib/kubelet/pods/307b1b3b-98e9-490c-b304-ab3cddb6663b/volumes"
Sep 16 18:38:05.742232 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:38:05.742217    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f84e938-4bba-4cba-9535-e2dfb67b126f" path="/var/lib/kubelet/pods/4f84e938-4bba-4cba-9535-e2dfb67b126f/volumes"
Sep 16 18:39:24.144452 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.144418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:39:24.145045 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.144635    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" podUID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" containerName="payload-pre-processing" containerID="cri-o://4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94" gracePeriod=30
Sep 16 18:39:24.405545 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.405480    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:39:24.508677 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.508642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vgkb\" (UniqueName: \"kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb\") pod \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") "
Sep 16 18:39:24.508844 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.508728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume\") pod \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\" (UID: \"b83c6c12-b8cb-429f-983e-9f9d6e97abc7\") "
Sep 16 18:39:24.509157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.509126    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b83c6c12-b8cb-429f-983e-9f9d6e97abc7" (UID: "b83c6c12-b8cb-429f-983e-9f9d6e97abc7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:39:24.510728 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.510700    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb" (OuterVolumeSpecName: "kube-api-access-5vgkb") pod "b83c6c12-b8cb-429f-983e-9f9d6e97abc7" (UID: "b83c6c12-b8cb-429f-983e-9f9d6e97abc7"). InnerVolumeSpecName "kube-api-access-5vgkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:39:24.558314 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.558272    2565 generic.go:356] "Generic (PLEG): container finished" podID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" containerID="4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94" exitCode=0
Sep 16 18:39:24.558314 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.558314    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"
Sep 16 18:39:24.558527 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.558370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" event={"ID":"b83c6c12-b8cb-429f-983e-9f9d6e97abc7","Type":"ContainerDied","Data":"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"}
Sep 16 18:39:24.558527 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.558417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw" event={"ID":"b83c6c12-b8cb-429f-983e-9f9d6e97abc7","Type":"ContainerDied","Data":"4f4d80c3ba41ca4a1bce22ad56be96baf80fd6ede17a0c0d73518b91c49868e9"}
Sep 16 18:39:24.558527 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.558440    2565 scope.go:117] "RemoveContainer" containerID="4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"
Sep 16 18:39:24.567331 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.567313    2565 scope.go:117] "RemoveContainer" containerID="4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"
Sep 16 18:39:24.567601 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:39:24.567583    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94\": container with ID starting with 4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94 not found: ID does not exist" containerID="4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"
Sep 16 18:39:24.567648 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.567609    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94"} err="failed to get container status \"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94\": rpc error: code = NotFound desc = could not find container \"4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94\": container with ID starting with 4de1d25d4f29215e251d490519b17b1906e822d489e2e15d0dec5e748b420f94 not found: ID does not exist"
Sep 16 18:39:24.579514 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.579491    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:39:24.585470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.585450    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-efa70c-5dffc9cf54-kh2fw"]
Sep 16 18:39:24.610177 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.610155    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:24.610177 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:24.610178    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vgkb\" (UniqueName: \"kubernetes.io/projected/b83c6c12-b8cb-429f-983e-9f9d6e97abc7-kube-api-access-5vgkb\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:25.740417 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:25.740383    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" path="/var/lib/kubelet/pods/b83c6c12-b8cb-429f-983e-9f9d6e97abc7/volumes"
Sep 16 18:39:32.572949 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:32.572916    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:39:32.573375 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:32.573146    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy" containerID="cri-o://368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e" gracePeriod=30
Sep 16 18:39:33.387276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387242    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:39:33.387660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387647    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307b1b3b-98e9-490c-b304-ab3cddb6663b" containerName="maas-api"
Sep 16 18:39:33.387714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387662    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="307b1b3b-98e9-490c-b304-ab3cddb6663b" containerName="maas-api"
Sep 16 18:39:33.387714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387674    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" containerName="payload-pre-processing"
Sep 16 18:39:33.387714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387680    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" containerName="payload-pre-processing"
Sep 16 18:39:33.387714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387687    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f84e938-4bba-4cba-9535-e2dfb67b126f" containerName="payload-pre-processing"
Sep 16 18:39:33.387714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387695    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f84e938-4bba-4cba-9535-e2dfb67b126f" containerName="payload-pre-processing"
Sep 16 18:39:33.387869 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387745    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b83c6c12-b8cb-429f-983e-9f9d6e97abc7" containerName="payload-pre-processing"
Sep 16 18:39:33.387869 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387754    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="307b1b3b-98e9-490c-b304-ab3cddb6663b" containerName="maas-api"
Sep 16 18:39:33.387869 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.387761    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f84e938-4bba-4cba-9535-e2dfb67b126f" containerName="payload-pre-processing"
Sep 16 18:39:33.392065 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.392048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.397730 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.397706    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-c8b23c-openshift-default-dockercfg-2ddd9\""
Sep 16 18:39:33.427485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.427452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:39:33.496731 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.496944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.496944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.496944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496817    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.496944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.497163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.497163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496975    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.497163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.496997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qvl\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.497163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.497055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.597569 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.597533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.597606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.597762    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.597821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.597846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qvl\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598451 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598618 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598477    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598618 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.598749 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.598730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.600918 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.600878    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.601052 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.601024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.611039 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.611010    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qvl\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.611903 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.611867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token\") pod \"e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") " pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.702400 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.702318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:33.985944 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.985921    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:39:33.988305 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:39:33.988277    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1637a5d_d965_4b2b_a074_da5b026db4bf.slice/crio-eaf064d17b476697141898795fe07737093d4ed4843785146da78c8aad7270ed WatchSource:0}: Error finding container eaf064d17b476697141898795fe07737093d4ed4843785146da78c8aad7270ed: Status 404 returned error can't find the container with id eaf064d17b476697141898795fe07737093d4ed4843785146da78c8aad7270ed
Sep 16 18:39:33.990511 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.990477    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:33.990590 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.990543    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:33.990590 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:33.990571    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:34.608752 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:34.608705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" event={"ID":"b1637a5d-d965-4b2b-a074-da5b026db4bf","Type":"ContainerStarted","Data":"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"}
Sep 16 18:39:34.609156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:34.608778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" event={"ID":"b1637a5d-d965-4b2b-a074-da5b026db4bf","Type":"ContainerStarted","Data":"eaf064d17b476697141898795fe07737093d4ed4843785146da78c8aad7270ed"}
Sep 16 18:39:34.633255 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:34.633206    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" podStartSLOduration=1.633189131 podStartE2EDuration="1.633189131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:39:34.631519175 +0000 UTC m=+1409.323961118" watchObservedRunningTime="2026-09-16 18:39:34.633189131 +0000 UTC m=+1409.325631070"
Sep 16 18:39:34.702702 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:34.702663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:35.708170 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:35.708139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:36.618523 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:36.618493    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:36.619530 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:36.619509    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:39:37.813826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.813796    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:39:37.936526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936433    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936519    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936537    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936686    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-np2mw\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.936799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token\") pod \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\" (UID: \"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11\") "
Sep 16 18:39:37.937110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:39:37.937110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:39:37.937110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936914    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:39:37.937110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.936999    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:39:37.937309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.937145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:39:37.937309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.937172    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:37.937309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.937190    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:37.937309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.937202    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:37.937309 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.937214    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:37.938958 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.938929    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:39:37.939127 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.939106    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw" (OuterVolumeSpecName: "kube-api-access-np2mw") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "kube-api-access-np2mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:39:37.939225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.939206    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:39:37.939277 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:37.939213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" (UID: "ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:39:38.038437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.038402    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:38.038437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.038431    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:38.038437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.038440    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:38.038670 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.038448    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-np2mw\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-kube-api-access-np2mw\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:38.038670 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.038457    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:39:38.628947 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.628880    2565 generic.go:356] "Generic (PLEG): container finished" podID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerID="368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e" exitCode=0
Sep 16 18:39:38.628947 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.628934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerDied","Data":"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"}
Sep 16 18:39:38.629194 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.628993    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"
Sep 16 18:39:38.629194 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.629019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6" event={"ID":"ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11","Type":"ContainerDied","Data":"670904c1683cf439bfa3e7b75d552c9adfc66de8664ed9700fa78e595621170f"}
Sep 16 18:39:38.629194 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.629042    2565 scope.go:117] "RemoveContainer" containerID="368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"
Sep 16 18:39:38.637995 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.637979    2565 scope.go:117] "RemoveContainer" containerID="0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"
Sep 16 18:39:38.645718 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.645702    2565 scope.go:117] "RemoveContainer" containerID="368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"
Sep 16 18:39:38.646027 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:39:38.646008    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e\": container with ID starting with 368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e not found: ID does not exist" containerID="368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"
Sep 16 18:39:38.646113 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.646040    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e"} err="failed to get container status \"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e\": rpc error: code = NotFound desc = could not find container \"368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e\": container with ID starting with 368c6465ab9f6b87adf95d6ff5ada952fa2ec8f59d7a619758c2d0dad735e56e not found: ID does not exist"
Sep 16 18:39:38.646113 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.646067    2565 scope.go:117] "RemoveContainer" containerID="0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"
Sep 16 18:39:38.646334 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:39:38.646314    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef\": container with ID starting with 0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef not found: ID does not exist" containerID="0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"
Sep 16 18:39:38.646400 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.646338    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef"} err="failed to get container status \"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef\": rpc error: code = NotFound desc = could not find container \"0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef\": container with ID starting with 0ed05436d936aacabd8719105fbb9d5f06bb3808de466839ffc07c2d3373dcef not found: ID does not exist"
Sep 16 18:39:38.683650 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.683619    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:39:38.697242 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:38.697218    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-efa70c-openshift-default-689cf88f48-gcbv6"]
Sep 16 18:39:39.740443 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:39.740410    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" path="/var/lib/kubelet/pods/ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11/volumes"
Sep 16 18:39:46.400217 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400177    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400546    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400556    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400570    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400575    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400634    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.400676 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.400644    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb8bb1d-bddd-4d9c-b42c-4a41a9c10c11" containerName="istio-proxy"
Sep 16 18:39:46.405130 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.405112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.415003 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.414983    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-58beb43a-openshift-default-dockercfg-fv4jl\""
Sep 16 18:39:46.448001 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.447971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:39:46.519597 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519597 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbq6\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.519847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.520193 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.519864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.620805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.620805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbq6\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620864    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.620984    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621082 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621382 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621382 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621382 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621511 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621694 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.621787 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.621769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.623306 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.623285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.623515 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.623496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.635023 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.634993    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbq6\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.636699 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.636670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token\") pod \"e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") " pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.714936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.714839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:46.995570 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:46.995544    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:39:46.997961 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:39:46.997932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc41a76_ca5e_409d_8e0a_376f97aa4bf5.slice/crio-d4b5c17045f1f932e24ef5d75370023bd0deb56ca319a612a84d2d30666a497a WatchSource:0}: Error finding container d4b5c17045f1f932e24ef5d75370023bd0deb56ca319a612a84d2d30666a497a: Status 404 returned error can't find the container with id d4b5c17045f1f932e24ef5d75370023bd0deb56ca319a612a84d2d30666a497a
Sep 16 18:39:47.000229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.000193    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:47.000340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.000258    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:47.000340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.000288    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:39:47.672978 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.672939    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerStarted","Data":"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"}
Sep 16 18:39:47.673385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.673021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerStarted","Data":"d4b5c17045f1f932e24ef5d75370023bd0deb56ca319a612a84d2d30666a497a"}
Sep 16 18:39:47.703653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.703599    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podStartSLOduration=1.703583172 podStartE2EDuration="1.703583172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:39:47.702997295 +0000 UTC m=+1422.395439238" watchObservedRunningTime="2026-09-16 18:39:47.703583172 +0000 UTC m=+1422.396025114"
Sep 16 18:39:47.714964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:47.714935    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:48.721204 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:48.721172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:49.682561 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:49.682528    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:49.683373 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:49.683352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:39:55.627343 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.627301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:39:55.631008 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.630989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.634687 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.634659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-d8a600\"/\"e2e-conflict-a-8b493098-kserve-self-signed-certs\""
Sep 16 18:39:55.635620 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.635601    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-d8a600\"/\"default-dockercfg-vk6zb\""
Sep 16 18:39:55.635724 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.635676    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-d8a600\"/\"openshift-service-ca.crt\""
Sep 16 18:39:55.635789 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.635775    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-d8a600\"/\"kube-root-ca.crt\""
Sep 16 18:39:55.644186 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.644162    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:39:55.702013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.701981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.702182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.702026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcb42\" (UniqueName: \"kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.702182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.702047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.702182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.702069    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.702182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.702087    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.702320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.702191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803647 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcb42\" (UniqueName: \"kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803647 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803667    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.803941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.803883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.804206 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.804139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.804272 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.804197    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.804272 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.804262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.806008 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.805984    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.806471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.806442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.812652 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.812632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcb42\" (UniqueName: \"kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42\") pod \"e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") " pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:55.940478 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:55.940382    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:39:56.219714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:56.219684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:39:56.222086 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:39:56.222057    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f02af7a_d66a_42e4_880b_512d99363549.slice/crio-9bbc7dc535830d7a5099b66ee45275158c40913840399ab345c1225a6dc97bb5 WatchSource:0}: Error finding container 9bbc7dc535830d7a5099b66ee45275158c40913840399ab345c1225a6dc97bb5: Status 404 returned error can't find the container with id 9bbc7dc535830d7a5099b66ee45275158c40913840399ab345c1225a6dc97bb5
Sep 16 18:39:56.716484 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:56.716447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" event={"ID":"8f02af7a-d66a-42e4-880b-512d99363549","Type":"ContainerStarted","Data":"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"}
Sep 16 18:39:56.716957 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:56.716490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" event={"ID":"8f02af7a-d66a-42e4-880b-512d99363549","Type":"ContainerStarted","Data":"9bbc7dc535830d7a5099b66ee45275158c40913840399ab345c1225a6dc97bb5"}
Sep 16 18:39:56.743870 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:39:56.743814    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" podStartSLOduration=1.7437963829999998 podStartE2EDuration="1.743796383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:39:56.742446819 +0000 UTC m=+1431.434888762" watchObservedRunningTime="2026-09-16 18:39:56.743796383 +0000 UTC m=+1431.436238325"
Sep 16 18:40:05.940943 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:05.940879    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:40:05.941336 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:05.940962    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:40:05.953436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:05.953397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:40:06.777334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:06.777302    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:40:20.725060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:20.725009    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 18:40:20.725435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:20.725089    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 18:40:22.837350 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.837319    2565 generic.go:356] "Generic (PLEG): container finished" podID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerID="5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82" exitCode=0
Sep 16 18:40:22.837785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.837399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerDied","Data":"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"}
Sep 16 18:40:22.837785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.837780    2565 scope.go:117] "RemoveContainer" containerID="5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"
Sep 16 18:40:22.838850 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.838823    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:40:22.838962 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.838886    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:40:22.838962 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:22.838945    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:40:23.844541 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:23.844510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerStarted","Data":"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"}
Sep 16 18:40:24.716078 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:24.716034    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:24.716262 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:24.716235    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 16 18:40:24.716307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:24.716283    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 16 18:40:25.715671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:25.715635    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 16 18:40:25.716099 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:25.715697    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 16 18:40:26.715296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:26.715256    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 16 18:40:26.715608 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:26.715318    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 16 18:40:27.715386 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:27.715342    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 16 18:40:27.715795 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:27.715405    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 16 18:40:28.715301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:28.715259    2565 patch_prober.go:28] interesting pod/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body=
Sep 16 18:40:28.715485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:28.715324    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused"
Sep 16 18:40:29.718826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:29.718792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:29.719274 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:29.719118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:29.719800 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:29.719783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:51.098471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:51.098419    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:40:51.098857 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:51.098666    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy" containerID="cri-o://bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895" gracePeriod=30
Sep 16 18:40:56.340759 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.340734    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:56.457573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457483    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nbq6\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457616    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457680    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457756    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.457856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy\") pod \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\" (UID: \"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5\") "
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.457964    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458032    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458047    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458218    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458241    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458248    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:40:56.458307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.458255    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.460029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.459996    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:40:56.460029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.460013    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:40:56.460243 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.460222    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6" (OuterVolumeSpecName: "kube-api-access-2nbq6") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "kube-api-access-2nbq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:40:56.460296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.460280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" (UID: "6dc41a76-ca5e-409d-8e0a-376f97aa4bf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:40:56.559762 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559729    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nbq6\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-kube-api-access-2nbq6\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.559762 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559755    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.559762 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559764    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.560029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559773    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.560029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559781    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:56.560029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:56.559788    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:40:57.021077 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.021039    2565 generic.go:356] "Generic (PLEG): container finished" podID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerID="bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895" exitCode=0
Sep 16 18:40:57.021269 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.021093    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"
Sep 16 18:40:57.021269 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.021127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerDied","Data":"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"}
Sep 16 18:40:57.021269 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.021192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx" event={"ID":"6dc41a76-ca5e-409d-8e0a-376f97aa4bf5","Type":"ContainerDied","Data":"d4b5c17045f1f932e24ef5d75370023bd0deb56ca319a612a84d2d30666a497a"}
Sep 16 18:40:57.021269 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.021225    2565 scope.go:117] "RemoveContainer" containerID="bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"
Sep 16 18:40:57.030252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.030235    2565 scope.go:117] "RemoveContainer" containerID="5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"
Sep 16 18:40:57.038148 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.038130    2565 scope.go:117] "RemoveContainer" containerID="bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"
Sep 16 18:40:57.038420 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:40:57.038402    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895\": container with ID starting with bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895 not found: ID does not exist" containerID="bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"
Sep 16 18:40:57.038469 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.038428    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895"} err="failed to get container status \"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895\": rpc error: code = NotFound desc = could not find container \"bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895\": container with ID starting with bce9e68ce24bda990fa5b34ea53fde6ac4117aab4ecda0fea6f54ed88126b895 not found: ID does not exist"
Sep 16 18:40:57.038469 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.038447    2565 scope.go:117] "RemoveContainer" containerID="5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"
Sep 16 18:40:57.038682 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:40:57.038664    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82\": container with ID starting with 5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82 not found: ID does not exist" containerID="5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"
Sep 16 18:40:57.038740 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.038691    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82"} err="failed to get container status \"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82\": rpc error: code = NotFound desc = could not find container \"5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82\": container with ID starting with 5188518152b9cf4f4c1c47c10c97c398b27d8e3b71260982bf14a14ffc048e82 not found: ID does not exist"
Sep 16 18:40:57.059427 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.059404    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:40:57.075056 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.075034    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-58beb43a-openshift-default-7745cc49d8-g66vx"]
Sep 16 18:40:57.739995 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:40:57.739962    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" path="/var/lib/kubelet/pods/6dc41a76-ca5e-409d-8e0a-376f97aa4bf5/volumes"
Sep 16 18:41:05.815941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:05.815886    2565 scope.go:117] "RemoveContainer" containerID="605a1cd3cb3ba1c2c6d9e92a2f869e7af1d80af3a038520a2e8d319dba3fb09c"
Sep 16 18:41:06.247785 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:06.247704    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:41:06.247955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:06.247908    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerName="istio-proxy" containerID="cri-o://941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0" gracePeriod=30
Sep 16 18:41:06.621024 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:06.620991    2565 patch_prober.go:28] interesting pod/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 18:41:06.621182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:06.621053    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 18:41:11.503138 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.503111    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:41:11.609040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609040 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609088    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609146    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92qvl\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609283    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609298    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:11.609543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609311    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:11.609543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609404    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy\") pod \"b1637a5d-d965-4b2b-a074-da5b026db4bf\" (UID: \"b1637a5d-d965-4b2b-a074-da5b026db4bf\") "
Sep 16 18:41:11.609543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:11.609799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609743    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.609799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609764    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.609799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609779    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.610000 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609869    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:11.610000 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.609983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:41:11.611514 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.611479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:41:11.611626 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.611526    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl" (OuterVolumeSpecName: "kube-api-access-92qvl") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "kube-api-access-92qvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:11.611626 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.611580    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:11.611874 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.611853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1637a5d-d965-4b2b-a074-da5b026db4bf" (UID: "b1637a5d-d965-4b2b-a074-da5b026db4bf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:41:11.711293 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711248    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.711293 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711285    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.711293 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711299    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.711543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711311    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1637a5d-d965-4b2b-a074-da5b026db4bf-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.711543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711323    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1637a5d-d965-4b2b-a074-da5b026db4bf-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:11.711543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:11.711334    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92qvl\" (UniqueName: \"kubernetes.io/projected/b1637a5d-d965-4b2b-a074-da5b026db4bf-kube-api-access-92qvl\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:12.094178 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.094140    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerID="941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0" exitCode=0
Sep 16 18:41:12.094385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.094189    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"
Sep 16 18:41:12.094385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.094227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" event={"ID":"b1637a5d-d965-4b2b-a074-da5b026db4bf","Type":"ContainerDied","Data":"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"}
Sep 16 18:41:12.094385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.094297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q" event={"ID":"b1637a5d-d965-4b2b-a074-da5b026db4bf","Type":"ContainerDied","Data":"eaf064d17b476697141898795fe07737093d4ed4843785146da78c8aad7270ed"}
Sep 16 18:41:12.094385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.094327    2565 scope.go:117] "RemoveContainer" containerID="941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"
Sep 16 18:41:12.103020 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.102999    2565 scope.go:117] "RemoveContainer" containerID="941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"
Sep 16 18:41:12.103289 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:41:12.103272    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0\": container with ID starting with 941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0 not found: ID does not exist" containerID="941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"
Sep 16 18:41:12.103362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.103296    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0"} err="failed to get container status \"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0\": rpc error: code = NotFound desc = could not find container \"941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0\": container with ID starting with 941def7e3469cf8203b80c9117dec6a92212c1a8e5c2569d6eb6df6e75d21cf0 not found: ID does not exist"
Sep 16 18:41:12.150252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.150221    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:41:12.155729 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:12.155696    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-c8b23c-openshift-default-c48fd5fd6-rtw2q"]
Sep 16 18:41:13.741125 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:13.741085    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" path="/var/lib/kubelet/pods/b1637a5d-d965-4b2b-a074-da5b026db4bf/volumes"
Sep 16 18:41:14.320298 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320234    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:41:14.320699 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320679    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:14.320799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:14.320799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320722    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:14.320799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320730    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:14.320799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320758    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerName="istio-proxy"
Sep 16 18:41:14.320799 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320767    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerName="istio-proxy"
Sep 16 18:41:14.321078 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320861    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:14.321078 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.320877    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1637a5d-d965-4b2b-a074-da5b026db4bf" containerName="istio-proxy"
Sep 16 18:41:14.325437 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.325414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.328120 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.328101    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-04899e-openshift-default-dockercfg-7pb6v\""
Sep 16 18:41:14.354792 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.354766    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:41:14.436139 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436514 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436514 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.436514 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.436391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp46r\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537517 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537813    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.537882 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp46r\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.537947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.538107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.538155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538244 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.538218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538341 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.538316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.538550 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.538525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.539867 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.539848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.540197 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.540181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.559347 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.559316    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.559537 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.559515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp46r\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r\") pod \"e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") " pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.634952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.634867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:14.965247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.965216    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:41:14.966842 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:41:14.966815    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f586e74_6e19_4926_978c_7cc641e4bf67.slice/crio-8066a8ecbaacbfd18a6f811515678b82b356ac41aa4b0363591221398f6e0d32 WatchSource:0}: Error finding container 8066a8ecbaacbfd18a6f811515678b82b356ac41aa4b0363591221398f6e0d32: Status 404 returned error can't find the container with id 8066a8ecbaacbfd18a6f811515678b82b356ac41aa4b0363591221398f6e0d32
Sep 16 18:41:14.969293 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.969261    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:14.969366 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.969328    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:14.969366 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:14.969356    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:15.112970 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:15.112926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerStarted","Data":"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"}
Sep 16 18:41:15.113146 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:15.112998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerStarted","Data":"8066a8ecbaacbfd18a6f811515678b82b356ac41aa4b0363591221398f6e0d32"}
Sep 16 18:41:15.298399 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:15.298350    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podStartSLOduration=1.2983331 podStartE2EDuration="1.2983331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:15.280071598 +0000 UTC m=+1509.972513541" watchObservedRunningTime="2026-09-16 18:41:15.2983331 +0000 UTC m=+1509.990775042"
Sep 16 18:41:15.635561 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:15.635465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:16.396960 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.396925    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:41:16.397391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.397155    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" podUID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" containerName="maas-api" containerID="cri-o://061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4" gracePeriod=30
Sep 16 18:41:16.640623 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.640598    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:16.653110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.653047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:41:16.759359 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.759330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkhk5\" (UniqueName: \"kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5\") pod \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") "
Sep 16 18:41:16.759572 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.759397    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") pod \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") "
Sep 16 18:41:16.759572 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.759437    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs\") pod \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") "
Sep 16 18:41:16.759572 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.759514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca\") pod \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\" (UID: \"9d905ff2-3fe1-40c0-8bbe-58530fa128b2\") "
Sep 16 18:41:16.759956 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.759886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d905ff2-3fe1-40c0-8bbe-58530fa128b2" (UID: "9d905ff2-3fe1-40c0-8bbe-58530fa128b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:41:16.761601 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.761570    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5" (OuterVolumeSpecName: "kube-api-access-rkhk5") pod "9d905ff2-3fe1-40c0-8bbe-58530fa128b2" (UID: "9d905ff2-3fe1-40c0-8bbe-58530fa128b2"). InnerVolumeSpecName "kube-api-access-rkhk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:16.761756 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.761729    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d905ff2-3fe1-40c0-8bbe-58530fa128b2" (UID: "9d905ff2-3fe1-40c0-8bbe-58530fa128b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:41:16.761756 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.761747    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9d905ff2-3fe1-40c0-8bbe-58530fa128b2" (UID: "9d905ff2-3fe1-40c0-8bbe-58530fa128b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:41:16.861060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.861025    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:16.861060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.861057    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkhk5\" (UniqueName: \"kubernetes.io/projected/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-kube-api-access-rkhk5\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:16.861060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.861070    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:16.861333 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:16.861082    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9d905ff2-3fe1-40c0-8bbe-58530fa128b2-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:17.123420 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123378    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" containerID="061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4" exitCode=0
Sep 16 18:41:17.123617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123433    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"
Sep 16 18:41:17.123617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" event={"ID":"9d905ff2-3fe1-40c0-8bbe-58530fa128b2","Type":"ContainerDied","Data":"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"}
Sep 16 18:41:17.123617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q" event={"ID":"9d905ff2-3fe1-40c0-8bbe-58530fa128b2","Type":"ContainerDied","Data":"83dc77dbc57db41a8f2d803a687e9a8442836e93f8773a86f34cfe157cb3aa13"}
Sep 16 18:41:17.123617 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123570    2565 scope.go:117] "RemoveContainer" containerID="061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"
Sep 16 18:41:17.123946 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.123919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:17.125186 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.125165    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:17.133738 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.133710    2565 scope.go:117] "RemoveContainer" containerID="061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"
Sep 16 18:41:17.134056 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:41:17.134038    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4\": container with ID starting with 061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4 not found: ID does not exist" containerID="061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"
Sep 16 18:41:17.134125 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.134063    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4"} err="failed to get container status \"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4\": rpc error: code = NotFound desc = could not find container \"061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4\": container with ID starting with 061c91237e6efcd5628e7c8702a8f67851221adc30974eafd8d32f74db32f2c4 not found: ID does not exist"
Sep 16 18:41:17.241853 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.241821    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:41:17.252016 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.251989    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4ab744-588d867765-scq7q"]
Sep 16 18:41:17.745292 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:17.745254    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" path="/var/lib/kubelet/pods/9d905ff2-3fe1-40c0-8bbe-58530fa128b2/volumes"
Sep 16 18:41:25.522333 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.522298    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:41:25.522720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.522664    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" containerName="maas-api"
Sep 16 18:41:25.522720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.522676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" containerName="maas-api"
Sep 16 18:41:25.522795 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.522762    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d905ff2-3fe1-40c0-8bbe-58530fa128b2" containerName="maas-api"
Sep 16 18:41:25.522795 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.522772    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc41a76-ca5e-409d-8e0a-376f97aa4bf5" containerName="istio-proxy"
Sep 16 18:41:25.527318 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.527297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.531347 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.531328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-04899e\""
Sep 16 18:41:25.531347 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.531343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-04899e-dockercfg-72dlj\""
Sep 16 18:41:25.538635 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.538614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f5zd\" (UniqueName: \"kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.538734 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.538661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.626675 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.626632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:41:25.639808 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.639776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.640010 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.639930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f5zd\" (UniqueName: \"kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.640727 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.640702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.672754 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.672721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f5zd\" (UniqueName: \"kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd\") pod \"payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:25.836854 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:25.836820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:26.135651 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:26.135626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:41:26.137756 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:41:26.137727    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6425d4dd_43ed_4348_be80_3649eed2d5a7.slice/crio-04eef7421fd8b56f9b57ae4dce20070e61abcbc5a765112a8b51096dd745e747 WatchSource:0}: Error finding container 04eef7421fd8b56f9b57ae4dce20070e61abcbc5a765112a8b51096dd745e747: Status 404 returned error can't find the container with id 04eef7421fd8b56f9b57ae4dce20070e61abcbc5a765112a8b51096dd745e747
Sep 16 18:41:26.164471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:26.164445    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" event={"ID":"6425d4dd-43ed-4348-be80-3649eed2d5a7","Type":"ContainerStarted","Data":"04eef7421fd8b56f9b57ae4dce20070e61abcbc5a765112a8b51096dd745e747"}
Sep 16 18:41:27.172447 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:27.172409    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" event={"ID":"6425d4dd-43ed-4348-be80-3649eed2d5a7","Type":"ContainerStarted","Data":"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"}
Sep 16 18:41:27.172820 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:27.172550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:27.216986 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:27.216934    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" podStartSLOduration=2.21691966 podStartE2EDuration="2.21691966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:27.215279287 +0000 UTC m=+1521.907721234" watchObservedRunningTime="2026-09-16 18:41:27.21691966 +0000 UTC m=+1521.909361599"
Sep 16 18:41:38.179013 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:38.178929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:41:44.251781 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.251753    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerID="4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5" exitCode=0
Sep 16 18:41:44.252131 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.251820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerDied","Data":"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"}
Sep 16 18:41:44.252234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.252220    2565 scope.go:117] "RemoveContainer" containerID="4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"
Sep 16 18:41:44.253280 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.253250    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:44.253382 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.253338    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:44.253446 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:44.253389    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:45.223338 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.223303    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:41:45.223553 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.223524    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" podUID="e42d92ca-2f52-4dc5-a24d-83f53833b770" containerName="maas-api" containerID="cri-o://c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080" gracePeriod=30
Sep 16 18:41:45.262325 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.262282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerStarted","Data":"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"}
Sep 16 18:41:45.480540 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.480480    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:41:45.542144 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.542113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs\") pod \"e42d92ca-2f52-4dc5-a24d-83f53833b770\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") "
Sep 16 18:41:45.542392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.542167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca\") pod \"e42d92ca-2f52-4dc5-a24d-83f53833b770\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") "
Sep 16 18:41:45.542392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.542189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttjbv\" (UniqueName: \"kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv\") pod \"e42d92ca-2f52-4dc5-a24d-83f53833b770\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") "
Sep 16 18:41:45.542392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.542257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls\") pod \"e42d92ca-2f52-4dc5-a24d-83f53833b770\" (UID: \"e42d92ca-2f52-4dc5-a24d-83f53833b770\") "
Sep 16 18:41:45.542593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.542566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e42d92ca-2f52-4dc5-a24d-83f53833b770" (UID: "e42d92ca-2f52-4dc5-a24d-83f53833b770"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:41:45.544384 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.544354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv" (OuterVolumeSpecName: "kube-api-access-ttjbv") pod "e42d92ca-2f52-4dc5-a24d-83f53833b770" (UID: "e42d92ca-2f52-4dc5-a24d-83f53833b770"). InnerVolumeSpecName "kube-api-access-ttjbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:41:45.544504 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.544380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e42d92ca-2f52-4dc5-a24d-83f53833b770" (UID: "e42d92ca-2f52-4dc5-a24d-83f53833b770"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:41:45.544504 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.544430    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e42d92ca-2f52-4dc5-a24d-83f53833b770" (UID: "e42d92ca-2f52-4dc5-a24d-83f53833b770"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:41:45.635780 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.635741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:45.637063 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.637036    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:45.637209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.637095    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:45.643535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.643507    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:45.643535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.643534    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e42d92ca-2f52-4dc5-a24d-83f53833b770-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:45.643688 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.643545    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttjbv\" (UniqueName: \"kubernetes.io/projected/e42d92ca-2f52-4dc5-a24d-83f53833b770-kube-api-access-ttjbv\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:45.643688 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:45.643553    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e42d92ca-2f52-4dc5-a24d-83f53833b770-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:41:46.268530 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.268491    2565 generic.go:356] "Generic (PLEG): container finished" podID="e42d92ca-2f52-4dc5-a24d-83f53833b770" containerID="c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080" exitCode=0
Sep 16 18:41:46.268997 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.268540    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"
Sep 16 18:41:46.268997 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.268573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" event={"ID":"e42d92ca-2f52-4dc5-a24d-83f53833b770","Type":"ContainerDied","Data":"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"}
Sep 16 18:41:46.268997 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.268622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6" event={"ID":"e42d92ca-2f52-4dc5-a24d-83f53833b770","Type":"ContainerDied","Data":"01aa921a2930ff5bfb892da470f5c05bf98ea1f7583764bb976807157cd28776"}
Sep 16 18:41:46.268997 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.268645    2565 scope.go:117] "RemoveContainer" containerID="c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"
Sep 16 18:41:46.277447 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.277427    2565 scope.go:117] "RemoveContainer" containerID="c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"
Sep 16 18:41:46.277703 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:41:46.277684    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080\": container with ID starting with c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080 not found: ID does not exist" containerID="c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"
Sep 16 18:41:46.277765 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.277714    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080"} err="failed to get container status \"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080\": rpc error: code = NotFound desc = could not find container \"c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080\": container with ID starting with c04130736381b8cc78ca243cc6feac4dc180449a6a86c9107091eea352b64080 not found: ID does not exist"
Sep 16 18:41:46.294947 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.294924    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:41:46.303911 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.303870    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6ef84e-594ffdb9d8-gjrn6"]
Sep 16 18:41:46.636225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.636195    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:46.636387 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:46.636246    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:47.123773 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.123736    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:41:47.124226 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.124206    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e42d92ca-2f52-4dc5-a24d-83f53833b770" containerName="maas-api"
Sep 16 18:41:47.124226 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.124226    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e42d92ca-2f52-4dc5-a24d-83f53833b770" containerName="maas-api"
Sep 16 18:41:47.124387 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.124330    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e42d92ca-2f52-4dc5-a24d-83f53833b770" containerName="maas-api"
Sep 16 18:41:47.127340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.127319    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:47.127481 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.127436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.136588 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.136563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-520999\""
Sep 16 18:41:47.136705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.136662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-520999-dockercfg-4jgwm\""
Sep 16 18:41:47.168964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.168922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:41:47.260919 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.258443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.260919 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.258639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cbmr\" (UniqueName: \"kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.359395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.359339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cbmr\" (UniqueName: \"kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.359884 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.359485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.360448 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.360417    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.392715 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.392649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cbmr\" (UniqueName: \"kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr\") pod \"payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.437640 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.437603    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:47.637071 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.636303    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:47.637071 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.636371    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:47.740586 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.740506    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e42d92ca-2f52-4dc5-a24d-83f53833b770" path="/var/lib/kubelet/pods/e42d92ca-2f52-4dc5-a24d-83f53833b770/volumes"
Sep 16 18:41:47.753345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:47.753303    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:41:48.280796 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.280758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" event={"ID":"28ecc79e-79ab-4d31-9739-dc366fb2abde","Type":"ContainerStarted","Data":"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"}
Sep 16 18:41:48.281001 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.280814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" event={"ID":"28ecc79e-79ab-4d31-9739-dc366fb2abde","Type":"ContainerStarted","Data":"f4cc3f686eb4f5a02397b04905eeb2007db6ff4077b2fd414f9060f44a787db9"}
Sep 16 18:41:48.281156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.281138    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:48.314623 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.314569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" podStartSLOduration=1.314550866 podStartE2EDuration="1.314550866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:48.312166868 +0000 UTC m=+1543.004608810" watchObservedRunningTime="2026-09-16 18:41:48.314550866 +0000 UTC m=+1543.006992835"
Sep 16 18:41:48.635817 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.635764    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:48.636225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:48.635841    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:49.635806 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:49.635765    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:49.635988 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:49.635844    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:50.635456 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:50.635420    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:50.635639 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:50.635477    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:51.635552 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:51.635509    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 16 18:41:51.635949 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:51.635575    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 16 18:41:52.639746 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:52.639716    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:52.640850 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:52.640829    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:41:57.908707 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.908668    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:41:57.911273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.911254    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.915422 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.915386    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-8edc30-openshift-default-dockercfg-thpqw\""
Sep 16 18:41:57.953838 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.953806    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:41:57.978268 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8flw\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:57.978695 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:57.978685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079321 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079321 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079703 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079760 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8flw\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079814 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079814 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079957 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.079957 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.079855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.080161 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.080135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.080288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.080196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.080352 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.080336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.080411 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.080387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.082240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.082214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.082240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.082229    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.170519 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.170436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8flw\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.173235 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.173209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token\") pod \"e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") " pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.224033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.223992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:41:58.512032 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.511999    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:41:58.513393 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:41:58.513360    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51af0412_b972_45e2_a3ed_284c0fe2c6f7.slice/crio-afe88ef5b00778ac87e5aa0042d3968df76f9b430f2110e1e2878bdde633c473 WatchSource:0}: Error finding container afe88ef5b00778ac87e5aa0042d3968df76f9b430f2110e1e2878bdde633c473: Status 404 returned error can't find the container with id afe88ef5b00778ac87e5aa0042d3968df76f9b430f2110e1e2878bdde633c473
Sep 16 18:41:58.515836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.515792    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:58.516000 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.515886    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:58.516000 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:58.515967    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:41:59.287904 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:59.287865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:41:59.337204 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:59.337159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerStarted","Data":"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"}
Sep 16 18:41:59.337365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:59.337229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerStarted","Data":"afe88ef5b00778ac87e5aa0042d3968df76f9b430f2110e1e2878bdde633c473"}
Sep 16 18:41:59.372864 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:41:59.372796    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podStartSLOduration=2.3727706 podStartE2EDuration="2.3727706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:41:59.37209883 +0000 UTC m=+1554.064540774" watchObservedRunningTime="2026-09-16 18:41:59.3727706 +0000 UTC m=+1554.065212544"
Sep 16 18:42:00.224964 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:00.224919    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:00.230227 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:00.230201    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:00.341714 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:00.341677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:00.342667 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:00.342649    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:13.048328 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.048284    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:42:13.051753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.051729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.054163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.054135    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ab83f76b-serving-cert\""
Sep 16 18:42:13.070055 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.070025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:42:13.140783 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.140735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.140969 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.140796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6h4\" (UniqueName: \"kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.141017 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.140959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.141017 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.141005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.242240 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.242202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.242435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.242254    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.242435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.242292    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.242435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.242312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6h4\" (UniqueName: \"kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.242435 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:42:13.242401    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-serving-cert: secret "maas-api-e2e-mt-ab83f76b-serving-cert" not found
Sep 16 18:42:13.242649 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:42:13.242490    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls podName:f310472f-563e-4c18-895c-5f1bd5e11586 nodeName:}" failed. No retries permitted until 2026-09-16 18:42:13.742469462 +0000 UTC m=+1568.434911381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls") pod "maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" (UID: "f310472f-563e-4c18-895c-5f1bd5e11586") : secret "maas-api-e2e-mt-ab83f76b-serving-cert" not found
Sep 16 18:42:13.243111 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.243085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.244769 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.244751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.252754 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.252730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6h4\" (UniqueName: \"kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.747843 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.747811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.750167 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.750142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") pod \"maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:13.816107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.816070    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:42:13.818512 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.818495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:13.821340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.821317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ab83f76b\""
Sep 16 18:42:13.832607 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.832583    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:42:13.950214 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.950180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:13.950385 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.950258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wnnn\" (UniqueName: \"kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:13.964108 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:13.964070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:14.051375 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.051344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wnnn\" (UniqueName: \"kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:14.051753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.051450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:14.052116 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.052098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:14.060283 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.060264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wnnn\" (UniqueName: \"kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn\") pod \"payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") " pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:14.129033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.128996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:14.239262 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.239237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:42:14.241753 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:42:14.241717    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf310472f_563e_4c18_895c_5f1bd5e11586.slice/crio-69f3c0cd2dc3b5643a5cce3fa5d439f8ad386774c68d98d7dc11b5aaa7a177dc WatchSource:0}: Error finding container 69f3c0cd2dc3b5643a5cce3fa5d439f8ad386774c68d98d7dc11b5aaa7a177dc: Status 404 returned error can't find the container with id 69f3c0cd2dc3b5643a5cce3fa5d439f8ad386774c68d98d7dc11b5aaa7a177dc
Sep 16 18:42:14.408406 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.408368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" event={"ID":"f310472f-563e-4c18-895c-5f1bd5e11586","Type":"ContainerStarted","Data":"69f3c0cd2dc3b5643a5cce3fa5d439f8ad386774c68d98d7dc11b5aaa7a177dc"}
Sep 16 18:42:14.408936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:14.408913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:42:14.411488 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:42:14.411461    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dec54b0_4db0_4c9b_9752_85aa8abf7eb1.slice/crio-ed5e7db6863876d30f8cd3d2651f00e0a22b2318de4df3a6b035cf679976ad5e WatchSource:0}: Error finding container ed5e7db6863876d30f8cd3d2651f00e0a22b2318de4df3a6b035cf679976ad5e: Status 404 returned error can't find the container with id ed5e7db6863876d30f8cd3d2651f00e0a22b2318de4df3a6b035cf679976ad5e
Sep 16 18:42:15.416286 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.416225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" event={"ID":"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1","Type":"ContainerStarted","Data":"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"}
Sep 16 18:42:15.416863 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.416296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:15.416863 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.416323    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" event={"ID":"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1","Type":"ContainerStarted","Data":"ed5e7db6863876d30f8cd3d2651f00e0a22b2318de4df3a6b035cf679976ad5e"}
Sep 16 18:42:15.418005 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.417982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" event={"ID":"f310472f-563e-4c18-895c-5f1bd5e11586","Type":"ContainerStarted","Data":"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"}
Sep 16 18:42:15.418125 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.418051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:15.450463 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:15.450403    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" podStartSLOduration=2.450383823 podStartE2EDuration="2.450383823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:15.44968225 +0000 UTC m=+1570.142124192" watchObservedRunningTime="2026-09-16 18:42:15.450383823 +0000 UTC m=+1570.142825788"
Sep 16 18:42:21.428399 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:21.428356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:42:21.467377 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:21.467304    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" podStartSLOduration=8.058162546 podStartE2EDuration="8.467288959s" totalImagesPullingTime="409.126413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:15.487140126 +0000 UTC m=+1570.179582068" watchObservedRunningTime="2026-09-16 18:42:21.467288959 +0000 UTC m=+1576.159730912"
Sep 16 18:42:24.800672 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.800632    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:42:24.805583 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.805558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.808735 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.808711    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-ee3af0-dockercfg-msgrm\""
Sep 16 18:42:24.809283 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.809267    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-ee3af0\""
Sep 16 18:42:24.821759 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.821735    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:42:24.864397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.864353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.864582 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.864427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdx6\" (UniqueName: \"kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.965848 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.965811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.966044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.965914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdx6\" (UniqueName: \"kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.966552 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.966527    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:24.977540 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:24.977517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdx6\" (UniqueName: \"kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6\") pod \"payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:25.116041 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:25.115941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:25.396810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:25.396708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:42:25.400440 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:42:25.400405    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0447004_a096_4bc0_815e_a0a82b930e4f.slice/crio-8647580e8614dfde4bf20af5aca14658e231a8109553faabb6c67d88449237af WatchSource:0}: Error finding container 8647580e8614dfde4bf20af5aca14658e231a8109553faabb6c67d88449237af: Status 404 returned error can't find the container with id 8647580e8614dfde4bf20af5aca14658e231a8109553faabb6c67d88449237af
Sep 16 18:42:25.470119 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:25.470092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" event={"ID":"d0447004-a096-4bc0-815e-a0a82b930e4f","Type":"ContainerStarted","Data":"8647580e8614dfde4bf20af5aca14658e231a8109553faabb6c67d88449237af"}
Sep 16 18:42:26.424774 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:26.424743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:42:26.477110 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:26.477067    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" event={"ID":"d0447004-a096-4bc0-815e-a0a82b930e4f","Type":"ContainerStarted","Data":"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"}
Sep 16 18:42:26.477284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:26.477136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:26.527288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:26.527226    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" podStartSLOduration=2.527203598 podStartE2EDuration="2.527203598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:42:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:42:26.525584982 +0000 UTC m=+1581.218026932" watchObservedRunningTime="2026-09-16 18:42:26.527203598 +0000 UTC m=+1581.219645545"
Sep 16 18:42:35.529277 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.529242    2565 generic.go:356] "Generic (PLEG): container finished" podID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerID="933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281" exitCode=0
Sep 16 18:42:35.529713 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.529317    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerDied","Data":"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"}
Sep 16 18:42:35.529832 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.529815    2565 scope.go:117] "RemoveContainer" containerID="933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"
Sep 16 18:42:35.531070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.531036    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:35.531177 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.531110    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:35.531177 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:35.531143    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:42:36.536406 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:36.536372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerStarted","Data":"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"}
Sep 16 18:42:37.224169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:37.224127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:37.224450 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:37.224427    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:42:37.224500 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:37.224484    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 18:42:37.491768 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:37.491689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:42:38.225301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:38.225256    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:42:38.225775 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:38.225320    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 18:42:39.224589 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:39.224544    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:42:39.224780 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:39.224608    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 18:42:40.225182 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:40.225137    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:42:40.225626 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:40.225210    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 18:42:41.225383 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:41.225346    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 16 18:42:41.225856 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:41.225410    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 16 18:42:42.229503 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:42.229466    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:42.229913 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:42.229741    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:42:42.230556 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:42:42.230533    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:44:14.196832 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:14.196794    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:44:29.216886 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.216768    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" podUID="8f02af7a-d66a-42e4-880b-512d99363549" containerName="main" containerID="cri-o://2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b" gracePeriod=45
Sep 16 18:44:29.468851 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.468785    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:44:29.574334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574510 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574510 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574400    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574510 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574455    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574689 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574571    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574689 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcb42\" (UniqueName: \"kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42\") pod \"8f02af7a-d66a-42e4-880b-512d99363549\" (UID: \"8f02af7a-d66a-42e4-880b-512d99363549\") "
Sep 16 18:44:29.574689 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574642    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home" (OuterVolumeSpecName: "home") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:29.574833 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:29.574870 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.574825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:29.575086 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.575062    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-home\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.575195 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.575089    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-tmp-dir\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.575195 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.575103    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-model-cache\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.576659 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.576632    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:29.576739 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.576662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm" (OuterVolumeSpecName: "dshm") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:44:29.576739 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.576704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42" (OuterVolumeSpecName: "kube-api-access-hcb42") pod "8f02af7a-d66a-42e4-880b-512d99363549" (UID: "8f02af7a-d66a-42e4-880b-512d99363549"). InnerVolumeSpecName "kube-api-access-hcb42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:29.676464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.676430    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcb42\" (UniqueName: \"kubernetes.io/projected/8f02af7a-d66a-42e4-880b-512d99363549-kube-api-access-hcb42\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.676464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.676462    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f02af7a-d66a-42e4-880b-512d99363549-tls-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.676464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.676473    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f02af7a-d66a-42e4-880b-512d99363549-dshm\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:29.766696 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.766660    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:44:29.766955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.766927    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" podUID="01ea5ebc-c666-49b3-9844-18b2b806580f" containerName="maas-api" containerID="cri-o://881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50" gracePeriod=30
Sep 16 18:44:29.838543 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.838509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:44:29.839539 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:29.838830    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" podUID="81a33244-1482-4945-a6f5-78675f597827" containerName="payload-pre-processing" containerID="cri-o://ea2c1a6519229ef963beddd9a175b68a4caf3220e06d950f43870fbe660141d3" gracePeriod=30
Sep 16 18:44:30.075621 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.075595    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:44:30.108291 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.108195    2565 generic.go:356] "Generic (PLEG): container finished" podID="81a33244-1482-4945-a6f5-78675f597827" containerID="ea2c1a6519229ef963beddd9a175b68a4caf3220e06d950f43870fbe660141d3" exitCode=0
Sep 16 18:44:30.108447 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.108298    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" event={"ID":"81a33244-1482-4945-a6f5-78675f597827","Type":"ContainerDied","Data":"ea2c1a6519229ef963beddd9a175b68a4caf3220e06d950f43870fbe660141d3"}
Sep 16 18:44:30.115766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.113131    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f02af7a-d66a-42e4-880b-512d99363549" containerID="2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b" exitCode=0
Sep 16 18:44:30.115766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.113444    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"
Sep 16 18:44:30.115766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.114237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" event={"ID":"8f02af7a-d66a-42e4-880b-512d99363549","Type":"ContainerDied","Data":"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"}
Sep 16 18:44:30.115766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.114279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs" event={"ID":"8f02af7a-d66a-42e4-880b-512d99363549","Type":"ContainerDied","Data":"9bbc7dc535830d7a5099b66ee45275158c40913840399ab345c1225a6dc97bb5"}
Sep 16 18:44:30.115766 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.114303    2565 scope.go:117] "RemoveContainer" containerID="2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"
Sep 16 18:44:30.124071 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.120821    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:44:30.124470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.124307    2565 generic.go:356] "Generic (PLEG): container finished" podID="01ea5ebc-c666-49b3-9844-18b2b806580f" containerID="881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50" exitCode=0
Sep 16 18:44:30.124470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.124387    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" event={"ID":"01ea5ebc-c666-49b3-9844-18b2b806580f","Type":"ContainerDied","Data":"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"}
Sep 16 18:44:30.124470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.124437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc" event={"ID":"01ea5ebc-c666-49b3-9844-18b2b806580f","Type":"ContainerDied","Data":"2bf88fabf76481aebcfdc5e19a19f2a728a53e718d46f40a2f85dc3369478d3f"}
Sep 16 18:44:30.124470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.124448    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"
Sep 16 18:44:30.133351 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.133330    2565 scope.go:117] "RemoveContainer" containerID="2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"
Sep 16 18:44:30.133689 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:44:30.133670    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b\": container with ID starting with 2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b not found: ID does not exist" containerID="2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"
Sep 16 18:44:30.133776 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.133699    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b"} err="failed to get container status \"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b\": rpc error: code = NotFound desc = could not find container \"2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b\": container with ID starting with 2e61249fabe829160e5e229ba104fa001b11d48857ac3e3bb38d07749afcba4b not found: ID does not exist"
Sep 16 18:44:30.133776 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.133716    2565 scope.go:117] "RemoveContainer" containerID="881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"
Sep 16 18:44:30.143812 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.143783    2565 scope.go:117] "RemoveContainer" containerID="881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"
Sep 16 18:44:30.144120 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:44:30.144096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50\": container with ID starting with 881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50 not found: ID does not exist" containerID="881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"
Sep 16 18:44:30.144209 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.144131    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50"} err="failed to get container status \"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50\": rpc error: code = NotFound desc = could not find container \"881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50\": container with ID starting with 881c9f0856d8f4ffd1dc0a2657e30957e903a2e83be10cc2eccd2c7d39c63d50 not found: ID does not exist"
Sep 16 18:44:30.182464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182433    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fqc9\" (UniqueName: \"kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9\") pod \"81a33244-1482-4945-a6f5-78675f597827\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") "
Sep 16 18:44:30.182620 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182546    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca\") pod \"01ea5ebc-c666-49b3-9844-18b2b806580f\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") "
Sep 16 18:44:30.182620 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182594    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") pod \"01ea5ebc-c666-49b3-9844-18b2b806580f\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") "
Sep 16 18:44:30.182725 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182618    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8khxb\" (UniqueName: \"kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb\") pod \"01ea5ebc-c666-49b3-9844-18b2b806580f\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") "
Sep 16 18:44:30.182725 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182657    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs\") pod \"01ea5ebc-c666-49b3-9844-18b2b806580f\" (UID: \"01ea5ebc-c666-49b3-9844-18b2b806580f\") "
Sep 16 18:44:30.182725 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182694    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume\") pod \"81a33244-1482-4945-a6f5-78675f597827\" (UID: \"81a33244-1482-4945-a6f5-78675f597827\") "
Sep 16 18:44:30.182978 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.182944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01ea5ebc-c666-49b3-9844-18b2b806580f" (UID: "01ea5ebc-c666-49b3-9844-18b2b806580f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:44:30.183168 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.183132    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81a33244-1482-4945-a6f5-78675f597827" (UID: "81a33244-1482-4945-a6f5-78675f597827"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:44:30.183283 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.183145    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ea5ebc-c666-49b3-9844-18b2b806580f-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.184829 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.184807    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "01ea5ebc-c666-49b3-9844-18b2b806580f" (UID: "01ea5ebc-c666-49b3-9844-18b2b806580f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:30.184987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.184852    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb" (OuterVolumeSpecName: "kube-api-access-8khxb") pod "01ea5ebc-c666-49b3-9844-18b2b806580f" (UID: "01ea5ebc-c666-49b3-9844-18b2b806580f"). InnerVolumeSpecName "kube-api-access-8khxb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:30.185084 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.185062    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01ea5ebc-c666-49b3-9844-18b2b806580f" (UID: "01ea5ebc-c666-49b3-9844-18b2b806580f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:44:30.185126 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.185076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9" (OuterVolumeSpecName: "kube-api-access-5fqc9") pod "81a33244-1482-4945-a6f5-78675f597827" (UID: "81a33244-1482-4945-a6f5-78675f597827"). InnerVolumeSpecName "kube-api-access-5fqc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:44:30.191293 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.191272    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:44:30.195397 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.195372    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-d8a600/e2e-conflict-a-8b493098-kserve-64467bb47b-lxmbs"]
Sep 16 18:44:30.284284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.284252    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.284284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.284279    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81a33244-1482-4945-a6f5-78675f597827-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.284284 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.284290    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fqc9\" (UniqueName: \"kubernetes.io/projected/81a33244-1482-4945-a6f5-78675f597827-kube-api-access-5fqc9\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.284730 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.284300    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ea5ebc-c666-49b3-9844-18b2b806580f-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.284730 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.284308    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8khxb\" (UniqueName: \"kubernetes.io/projected/01ea5ebc-c666-49b3-9844-18b2b806580f-kube-api-access-8khxb\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:44:30.448833 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.448796    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:44:30.452149 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:30.452115    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-909a40-5cc7c9d69f-7mbcc"]
Sep 16 18:44:31.134386 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.134356    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"
Sep 16 18:44:31.134584 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.134355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn" event={"ID":"81a33244-1482-4945-a6f5-78675f597827","Type":"ContainerDied","Data":"7523a562a6bd36cbd7eac272802a845a94d90439d727f933a2b3e3c0669cc4c3"}
Sep 16 18:44:31.134584 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.134516    2565 scope.go:117] "RemoveContainer" containerID="ea2c1a6519229ef963beddd9a175b68a4caf3220e06d950f43870fbe660141d3"
Sep 16 18:44:31.163336 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.163308    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:44:31.167053 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.167027    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-909a40-cb5f459cd-gjtkn"]
Sep 16 18:44:31.740033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.739999    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ea5ebc-c666-49b3-9844-18b2b806580f" path="/var/lib/kubelet/pods/01ea5ebc-c666-49b3-9844-18b2b806580f/volumes"
Sep 16 18:44:31.740409 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.740394    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a33244-1482-4945-a6f5-78675f597827" path="/var/lib/kubelet/pods/81a33244-1482-4945-a6f5-78675f597827/volumes"
Sep 16 18:44:31.740753 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:44:31.740739    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f02af7a-d66a-42e4-880b-512d99363549" path="/var/lib/kubelet/pods/8f02af7a-d66a-42e4-880b-512d99363549/volumes"
Sep 16 18:45:00.193863 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.193824    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"]
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194251    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f02af7a-d66a-42e4-880b-512d99363549" containerName="main"
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194268    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f02af7a-d66a-42e4-880b-512d99363549" containerName="main"
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194286    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ea5ebc-c666-49b3-9844-18b2b806580f" containerName="maas-api"
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194291    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ea5ebc-c666-49b3-9844-18b2b806580f" containerName="maas-api"
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194311    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a33244-1482-4945-a6f5-78675f597827" containerName="payload-pre-processing"
Sep 16 18:45:00.194365 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194319    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a33244-1482-4945-a6f5-78675f597827" containerName="payload-pre-processing"
Sep 16 18:45:00.194646 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194381    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ea5ebc-c666-49b3-9844-18b2b806580f" containerName="maas-api"
Sep 16 18:45:00.194646 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194388    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a33244-1482-4945-a6f5-78675f597827" containerName="payload-pre-processing"
Sep 16 18:45:00.194646 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.194395    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f02af7a-d66a-42e4-880b-512d99363549" containerName="main"
Sep 16 18:45:00.197524 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.197506    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"
Sep 16 18:45:00.202223 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.202199    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cgwrl\""
Sep 16 18:45:00.207930 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.207912    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"
Sep 16 18:45:00.236670 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.236625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"]
Sep 16 18:45:00.238421 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.238391    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"]
Sep 16 18:45:00.242956 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.242932    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"
Sep 16 18:45:00.256666 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.256123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"]
Sep 16 18:45:00.259470 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.259444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"
Sep 16 18:45:00.486345 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.486319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"]
Sep 16 18:45:00.489216 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:45:00.489182    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85ac73c_e41f_41c7_bcf2_b22335d83a19.slice/crio-3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06 WatchSource:0}: Error finding container 3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06: Status 404 returned error can't find the container with id 3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06
Sep 16 18:45:00.491405 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.491379    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:45:00.548096 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:00.548071    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"]
Sep 16 18:45:00.550537 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:45:00.550504    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bbd1de_36da_47ce_8b65_cbd137907d80.slice/crio-3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7 WatchSource:0}: Error finding container 3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7: Status 404 returned error can't find the container with id 3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7
Sep 16 18:45:01.277203 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:01.277167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn" event={"ID":"c85ac73c-e41f-41c7-bcf2-b22335d83a19","Type":"ContainerStarted","Data":"3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06"}
Sep 16 18:45:01.278398 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:01.278371    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8" event={"ID":"b1bbd1de-36da-47ce-8b65-cbd137907d80","Type":"ContainerStarted","Data":"3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7"}
Sep 16 18:45:04.295169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:04.295133    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1bbd1de-36da-47ce-8b65-cbd137907d80" containerID="239e0bf7b2b061d47abcac47b5dc431a12bfcb2eddc4b659f32ac31ed9b7c116" exitCode=0
Sep 16 18:45:04.295625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:04.295225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8" event={"ID":"b1bbd1de-36da-47ce-8b65-cbd137907d80","Type":"ContainerDied","Data":"239e0bf7b2b061d47abcac47b5dc431a12bfcb2eddc4b659f32ac31ed9b7c116"}
Sep 16 18:45:04.296745 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:04.296723    2565 generic.go:356] "Generic (PLEG): container finished" podID="c85ac73c-e41f-41c7-bcf2-b22335d83a19" containerID="6ab0659a5f7e7cf5fd558fa3d33353583a1e09bfc6f895cf17bacead695b27b3" exitCode=0
Sep 16 18:45:04.296840 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:04.296800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn" event={"ID":"c85ac73c-e41f-41c7-bcf2-b22335d83a19","Type":"ContainerDied","Data":"6ab0659a5f7e7cf5fd558fa3d33353583a1e09bfc6f895cf17bacead695b27b3"}
Sep 16 18:45:05.443850 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:05.443815    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"
Sep 16 18:45:05.478188 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:05.478153    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"
Sep 16 18:45:06.307837 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.307807    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"
Sep 16 18:45:06.308051 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.307809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn" event={"ID":"c85ac73c-e41f-41c7-bcf2-b22335d83a19","Type":"ContainerDied","Data":"3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06"}
Sep 16 18:45:06.308051 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.307939    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fdcf913f4fd7adc6162c7711b9aa029b09b8c6d6c6905b1f511343337d69d06"
Sep 16 18:45:06.309276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.309255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8" event={"ID":"b1bbd1de-36da-47ce-8b65-cbd137907d80","Type":"ContainerDied","Data":"3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7"}
Sep 16 18:45:06.309392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.309284    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"
Sep 16 18:45:06.309392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:06.309288    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3575bf1ab9de36f2e360c99b40e6b5d0aa08a140c747c47789003642e889c9a7"
Sep 16 18:45:47.660131 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.660094    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:45:47.660659 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.660345    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" podUID="f310472f-563e-4c18-895c-5f1bd5e11586" containerName="maas-api" containerID="cri-o://fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960" gracePeriod=30
Sep 16 18:45:47.724656 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.724617    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:45:47.725068 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.724989    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" podUID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" containerName="payload-processing" containerID="cri-o://39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9" gracePeriod=30
Sep 16 18:45:47.969636 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.969612    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:45:47.990825 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:47.990798    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:45:48.020234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020199    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca\") pod \"f310472f-563e-4c18-895c-5f1bd5e11586\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") "
Sep 16 18:45:48.020387 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020279    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") pod \"f310472f-563e-4c18-895c-5f1bd5e11586\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") "
Sep 16 18:45:48.020387 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020344    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf6h4\" (UniqueName: \"kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4\") pod \"f310472f-563e-4c18-895c-5f1bd5e11586\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") "
Sep 16 18:45:48.020472 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs\") pod \"f310472f-563e-4c18-895c-5f1bd5e11586\" (UID: \"f310472f-563e-4c18-895c-5f1bd5e11586\") "
Sep 16 18:45:48.020590 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f310472f-563e-4c18-895c-5f1bd5e11586" (UID: "f310472f-563e-4c18-895c-5f1bd5e11586"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:45:48.020748 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.020724    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f310472f-563e-4c18-895c-5f1bd5e11586-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.022503 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.022476    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4" (OuterVolumeSpecName: "kube-api-access-nf6h4") pod "f310472f-563e-4c18-895c-5f1bd5e11586" (UID: "f310472f-563e-4c18-895c-5f1bd5e11586"). InnerVolumeSpecName "kube-api-access-nf6h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:48.022596 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.022539    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f310472f-563e-4c18-895c-5f1bd5e11586" (UID: "f310472f-563e-4c18-895c-5f1bd5e11586"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:45:48.022596 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.022529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f310472f-563e-4c18-895c-5f1bd5e11586" (UID: "f310472f-563e-4c18-895c-5f1bd5e11586"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:45:48.121432 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121394    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume\") pod \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") "
Sep 16 18:45:48.121627 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wnnn\" (UniqueName: \"kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn\") pod \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\" (UID: \"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1\") "
Sep 16 18:45:48.121707 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121687    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf6h4\" (UniqueName: \"kubernetes.io/projected/f310472f-563e-4c18-895c-5f1bd5e11586-kube-api-access-nf6h4\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.121764 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121706    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.121764 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121718    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f310472f-563e-4c18-895c-5f1bd5e11586-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.121863 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.121827    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" (UID: "3dec54b0-4db0-4c9b-9752-85aa8abf7eb1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:45:48.123790 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.123763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn" (OuterVolumeSpecName: "kube-api-access-4wnnn") pod "3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" (UID: "3dec54b0-4db0-4c9b-9752-85aa8abf7eb1"). InnerVolumeSpecName "kube-api-access-4wnnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:45:48.223234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.223142    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.223234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.223173    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wnnn\" (UniqueName: \"kubernetes.io/projected/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1-kube-api-access-4wnnn\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:45:48.515273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.515179    2565 generic.go:356] "Generic (PLEG): container finished" podID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" containerID="39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9" exitCode=0
Sep 16 18:45:48.515273 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.515224    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"
Sep 16 18:45:48.515532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.515266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" event={"ID":"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1","Type":"ContainerDied","Data":"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"}
Sep 16 18:45:48.515532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.515331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8" event={"ID":"3dec54b0-4db0-4c9b-9752-85aa8abf7eb1","Type":"ContainerDied","Data":"ed5e7db6863876d30f8cd3d2651f00e0a22b2318de4df3a6b035cf679976ad5e"}
Sep 16 18:45:48.515532 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.515361    2565 scope.go:117] "RemoveContainer" containerID="39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"
Sep 16 18:45:48.516719 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.516698    2565 generic.go:356] "Generic (PLEG): container finished" podID="f310472f-563e-4c18-895c-5f1bd5e11586" containerID="fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960" exitCode=0
Sep 16 18:45:48.516836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.516740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"
Sep 16 18:45:48.516836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.516764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" event={"ID":"f310472f-563e-4c18-895c-5f1bd5e11586","Type":"ContainerDied","Data":"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"}
Sep 16 18:45:48.516836 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.516802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z" event={"ID":"f310472f-563e-4c18-895c-5f1bd5e11586","Type":"ContainerDied","Data":"69f3c0cd2dc3b5643a5cce3fa5d439f8ad386774c68d98d7dc11b5aaa7a177dc"}
Sep 16 18:45:48.524165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.524071    2565 scope.go:117] "RemoveContainer" containerID="39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"
Sep 16 18:45:48.524419 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:45:48.524355    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9\": container with ID starting with 39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9 not found: ID does not exist" containerID="39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"
Sep 16 18:45:48.524419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.524388    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9"} err="failed to get container status \"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9\": rpc error: code = NotFound desc = could not find container \"39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9\": container with ID starting with 39ee28c9cdc33aba55180962e86da9e14a8f58fc13e678628afc79a41c15f6a9 not found: ID does not exist"
Sep 16 18:45:48.524419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.524410    2565 scope.go:117] "RemoveContainer" containerID="fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"
Sep 16 18:45:48.532621 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.532602    2565 scope.go:117] "RemoveContainer" containerID="fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"
Sep 16 18:45:48.532914 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:45:48.532880    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960\": container with ID starting with fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960 not found: ID does not exist" containerID="fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"
Sep 16 18:45:48.532990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.532927    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960"} err="failed to get container status \"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960\": rpc error: code = NotFound desc = could not find container \"fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960\": container with ID starting with fc2b120ebe3fb927e63f5ea445465d8b504b6b31a2b5bec058c2a20a00e26960 not found: ID does not exist"
Sep 16 18:45:48.550533 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.550509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:45:48.552373 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.552349    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ab83f76b-7f5cbf9b4f-whfx8"]
Sep 16 18:45:48.573148 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.573112    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:45:48.575809 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:48.575784    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ab83f76b-797bdfd9c6-2xz6z"]
Sep 16 18:45:49.740730 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:49.740698    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" path="/var/lib/kubelet/pods/3dec54b0-4db0-4c9b-9752-85aa8abf7eb1/volumes"
Sep 16 18:45:49.741128 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:49.741112    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f310472f-563e-4c18-895c-5f1bd5e11586" path="/var/lib/kubelet/pods/f310472f-563e-4c18-895c-5f1bd5e11586/volumes"
Sep 16 18:45:53.841449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:53.841416    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"]
Sep 16 18:45:53.846007 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:53.845985    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-8edc30-29826405-d56jn"]
Sep 16 18:45:55.740719 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:45:55.740676    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c85ac73c-e41f-41c7-bcf2-b22335d83a19" path="/var/lib/kubelet/pods/c85ac73c-e41f-41c7-bcf2-b22335d83a19/volumes"
Sep 16 18:46:44.295673 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:44.295642    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:46:44.296165 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:44.295834    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy" containerID="cri-o://04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01" gracePeriod=30
Sep 16 18:46:49.550334 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.550305    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:46:49.602664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602571    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.602664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602610    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.602664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8flw\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.602664 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602652    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.602857    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket\") pod \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\" (UID: \"51af0412-b972-45e2-a3ed-284c0fe2c6f7\") "
Sep 16 18:46:49.603036 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603017    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:49.603362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:49.603362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603279    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.603362 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603307    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:49.603537 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:49.603537 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.603518    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:46:49.605008 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.604979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:46:49.605171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.605152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:46:49.605422 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.605382    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:49.605671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.605651    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw" (OuterVolumeSpecName: "kube-api-access-v8flw") pod "51af0412-b972-45e2-a3ed-284c0fe2c6f7" (UID: "51af0412-b972-45e2-a3ed-284c0fe2c6f7"). InnerVolumeSpecName "kube-api-access-v8flw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:49.703961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703927    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.703961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703954    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.703961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703965    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.704199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703975    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8flw\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-kube-api-access-v8flw\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.704199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703983    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.704199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.703992    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.704199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.704000    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51af0412-b972-45e2-a3ed-284c0fe2c6f7-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.704199 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.704008    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51af0412-b972-45e2-a3ed-284c0fe2c6f7-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:49.804670 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.804633    2565 generic.go:356] "Generic (PLEG): container finished" podID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerID="04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01" exitCode=0
Sep 16 18:46:49.804831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.804683    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"
Sep 16 18:46:49.804831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.804714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerDied","Data":"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"}
Sep 16 18:46:49.804831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.804765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb" event={"ID":"51af0412-b972-45e2-a3ed-284c0fe2c6f7","Type":"ContainerDied","Data":"afe88ef5b00778ac87e5aa0042d3968df76f9b430f2110e1e2878bdde633c473"}
Sep 16 18:46:49.804831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.804794    2565 scope.go:117] "RemoveContainer" containerID="04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"
Sep 16 18:46:49.813266 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.813237    2565 scope.go:117] "RemoveContainer" containerID="933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"
Sep 16 18:46:49.823400 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.821674    2565 scope.go:117] "RemoveContainer" containerID="04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"
Sep 16 18:46:49.823965 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:46:49.823910    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01\": container with ID starting with 04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01 not found: ID does not exist" containerID="04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"
Sep 16 18:46:49.823965 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.823948    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01"} err="failed to get container status \"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01\": rpc error: code = NotFound desc = could not find container \"04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01\": container with ID starting with 04f7fc1b0c90368a7e9b1570a9f39e30a8cd088e384d96ba0155d728857c6e01 not found: ID does not exist"
Sep 16 18:46:49.824118 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.823971    2565 scope.go:117] "RemoveContainer" containerID="933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"
Sep 16 18:46:49.824296 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:46:49.824279    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281\": container with ID starting with 933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281 not found: ID does not exist" containerID="933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"
Sep 16 18:46:49.824344 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.824303    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281"} err="failed to get container status \"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281\": rpc error: code = NotFound desc = could not find container \"933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281\": container with ID starting with 933809223e8cab9676577cc661d96eba0b1b397621986210a33bd39464002281 not found: ID does not exist"
Sep 16 18:46:49.824929 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.824911    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:46:49.834316 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:49.834295    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8edc30-openshift-default-69c569bf6b-jn9gb"]
Sep 16 18:46:51.741030 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:51.740996    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" path="/var/lib/kubelet/pods/51af0412-b972-45e2-a3ed-284c0fe2c6f7/volumes"
Sep 16 18:46:55.810033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:55.810001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:46:55.810522 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:55.810265    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" podUID="d0447004-a096-4bc0-815e-a0a82b930e4f" containerName="payload-processing" containerID="cri-o://5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60" gracePeriod=30
Sep 16 18:46:56.054391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.054365    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:46:56.166048 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.165944    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume\") pod \"d0447004-a096-4bc0-815e-a0a82b930e4f\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") "
Sep 16 18:46:56.166234 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.166132    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdx6\" (UniqueName: \"kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6\") pod \"d0447004-a096-4bc0-815e-a0a82b930e4f\" (UID: \"d0447004-a096-4bc0-815e-a0a82b930e4f\") "
Sep 16 18:46:56.166394 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.166364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0447004-a096-4bc0-815e-a0a82b930e4f" (UID: "d0447004-a096-4bc0-815e-a0a82b930e4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:46:56.166485 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.166468    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0447004-a096-4bc0-815e-a0a82b930e4f-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:56.168277 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.168251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6" (OuterVolumeSpecName: "kube-api-access-fhdx6") pod "d0447004-a096-4bc0-815e-a0a82b930e4f" (UID: "d0447004-a096-4bc0-815e-a0a82b930e4f"). InnerVolumeSpecName "kube-api-access-fhdx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:46:56.266976 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.266937    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdx6\" (UniqueName: \"kubernetes.io/projected/d0447004-a096-4bc0-815e-a0a82b930e4f-kube-api-access-fhdx6\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:46:56.842215 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.842180    2565 generic.go:356] "Generic (PLEG): container finished" podID="d0447004-a096-4bc0-815e-a0a82b930e4f" containerID="5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60" exitCode=0
Sep 16 18:46:56.842680 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.842230    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"
Sep 16 18:46:56.842680 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.842266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" event={"ID":"d0447004-a096-4bc0-815e-a0a82b930e4f","Type":"ContainerDied","Data":"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"}
Sep 16 18:46:56.842680 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.842321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq" event={"ID":"d0447004-a096-4bc0-815e-a0a82b930e4f","Type":"ContainerDied","Data":"8647580e8614dfde4bf20af5aca14658e231a8109553faabb6c67d88449237af"}
Sep 16 18:46:56.842680 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.842343    2565 scope.go:117] "RemoveContainer" containerID="5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"
Sep 16 18:46:56.851419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.851392    2565 scope.go:117] "RemoveContainer" containerID="5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"
Sep 16 18:46:56.851720 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:46:56.851698    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60\": container with ID starting with 5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60 not found: ID does not exist" containerID="5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"
Sep 16 18:46:56.851803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.851732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60"} err="failed to get container status \"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60\": rpc error: code = NotFound desc = could not find container \"5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60\": container with ID starting with 5c51ac87c372ff356b8310d0d965d3661da65d387bd3e6be1d3a7f5a843dbe60 not found: ID does not exist"
Sep 16 18:46:56.870253 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.870221    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:46:56.877039 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:56.877015    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-ee3af0-5856f4d85-krddq"]
Sep 16 18:46:57.740408 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:46:57.740371    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0447004-a096-4bc0-815e-a0a82b930e4f" path="/var/lib/kubelet/pods/d0447004-a096-4bc0-815e-a0a82b930e4f/volumes"
Sep 16 18:47:47.615655 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.615622    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616002    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bbd1de-36da-47ce-8b65-cbd137907d80" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616016    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bbd1de-36da-47ce-8b65-cbd137907d80" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616030    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616041    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0447004-a096-4bc0-815e-a0a82b930e4f" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616047    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0447004-a096-4bc0-815e-a0a82b930e4f" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616059    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c85ac73c-e41f-41c7-bcf2-b22335d83a19" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616064    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c85ac73c-e41f-41c7-bcf2-b22335d83a19" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616072    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616078    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616084    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616089    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616094    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f310472f-563e-4c18-895c-5f1bd5e11586" containerName="maas-api"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616099    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f310472f-563e-4c18-895c-5f1bd5e11586" containerName="maas-api"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616151    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f310472f-563e-4c18-895c-5f1bd5e11586" containerName="maas-api"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616157    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616164    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dec54b0-4db0-4c9b-9752-85aa8abf7eb1" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616170    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bbd1de-36da-47ce-8b65-cbd137907d80" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616177    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c85ac73c-e41f-41c7-bcf2-b22335d83a19" containerName="cleanup"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616182    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0447004-a096-4bc0-815e-a0a82b930e4f" containerName="payload-processing"
Sep 16 18:47:47.616952 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.616188    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="51af0412-b972-45e2-a3ed-284c0fe2c6f7" containerName="istio-proxy"
Sep 16 18:47:47.617877 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.617859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.621408 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.621390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1f16eb-openshift-default-dockercfg-7g799\""
Sep 16 18:47:47.650482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.650436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:47:47.734163 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734316    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734548 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734548 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj7t7\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734548 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.734671 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.734575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835655 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835617    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835655 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj7t7\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.835955 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836174 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.835975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836174 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836174 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836174 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836174 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.836810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.836790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.838022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.838004    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.838377 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.838356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.849059 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.849039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.855464 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.855441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj7t7\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7\") pod \"e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") " pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:47.928493 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:47.928402    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:48.219588 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:48.219562    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:47:48.221589 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:47:48.221564    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200cbf15_3de5_4547_acf7_dbfedc44d6f2.slice/crio-6180e4c77149dec19213bf71642d09650ebb27afdf7711019c9082c4616cd284 WatchSource:0}: Error finding container 6180e4c77149dec19213bf71642d09650ebb27afdf7711019c9082c4616cd284: Status 404 returned error can't find the container with id 6180e4c77149dec19213bf71642d09650ebb27afdf7711019c9082c4616cd284
Sep 16 18:47:48.223683 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:48.223645    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:47:48.223761 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:48.223710    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:47:48.223761 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:48.223736    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:47:49.091443 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:49.091394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerStarted","Data":"b615f310dee6fc10feb016ec9dcab08e91e47bc863169af70c1521e80f06fc91"}
Sep 16 18:47:49.091831 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:49.091495    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerStarted","Data":"6180e4c77149dec19213bf71642d09650ebb27afdf7711019c9082c4616cd284"}
Sep 16 18:47:49.116413 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:49.116358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podStartSLOduration=2.116341958 podStartE2EDuration="2.116341958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:47:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:47:49.114290765 +0000 UTC m=+1903.806732706" watchObservedRunningTime="2026-09-16 18:47:49.116341958 +0000 UTC m=+1903.808783900"
Sep 16 18:47:49.929510 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:49.929468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:49.934974 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:49.934946    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:50.095909 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:50.095863    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:50.096763 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:50.096744    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:47:55.142872 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.142838    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:47:55.145259 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.145236    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.147977 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.147956    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1f16eb\""
Sep 16 18:47:55.223686 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.223654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:47:55.306731 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.306688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.306885 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.306826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8rq\" (UniqueName: \"kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.407518 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.407424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8rq\" (UniqueName: \"kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.407518 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.407505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.408226 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.408206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.416941 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.416919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8rq\" (UniqueName: \"kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq\") pod \"payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.455528 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.455489    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:55.731456 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:55.731431    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:47:55.733423 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:47:55.733392    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3176778_926a_451b_b6cb_dfd0f534024f.slice/crio-8319f1e9ed20091d933feb62d76cab787e1ea47309429fee0f9fac8719114859 WatchSource:0}: Error finding container 8319f1e9ed20091d933feb62d76cab787e1ea47309429fee0f9fac8719114859: Status 404 returned error can't find the container with id 8319f1e9ed20091d933feb62d76cab787e1ea47309429fee0f9fac8719114859
Sep 16 18:47:56.126171 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:56.126126    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" event={"ID":"d3176778-926a-451b-b6cb-dfd0f534024f","Type":"ContainerStarted","Data":"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"}
Sep 16 18:47:56.126372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:56.126188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" event={"ID":"d3176778-926a-451b-b6cb-dfd0f534024f","Type":"ContainerStarted","Data":"8319f1e9ed20091d933feb62d76cab787e1ea47309429fee0f9fac8719114859"}
Sep 16 18:47:56.126372 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:56.126215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:47:56.154506 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:47:56.154448    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" podStartSLOduration=1.154431918 podStartE2EDuration="1.154431918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:47:56.153269782 +0000 UTC m=+1910.845711725" watchObservedRunningTime="2026-09-16 18:47:56.154431918 +0000 UTC m=+1910.846873860"
Sep 16 18:48:07.132973 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:07.132943    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:48:10.204042 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.204012    2565 generic.go:356] "Generic (PLEG): container finished" podID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerID="b615f310dee6fc10feb016ec9dcab08e91e47bc863169af70c1521e80f06fc91" exitCode=0
Sep 16 18:48:10.204436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.204063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerDied","Data":"b615f310dee6fc10feb016ec9dcab08e91e47bc863169af70c1521e80f06fc91"}
Sep 16 18:48:10.204436 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.204389    2565 scope.go:117] "RemoveContainer" containerID="b615f310dee6fc10feb016ec9dcab08e91e47bc863169af70c1521e80f06fc91"
Sep 16 18:48:10.205460 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.205429    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:10.205517 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.205501    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:10.205559 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:10.205532    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 18:48:11.210552 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:11.210516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerStarted","Data":"e01bf5df8a01e708fc493efdcf13cdc179edc14ce07c8b417443ea1e3ecf46ca"}
Sep 16 18:48:11.928969 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:11.928931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:48:11.929160 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:11.929135    2565 patch_prober.go:28] interesting pod/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:48:11.929212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:11.929186    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 16 18:48:12.929661 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:12.929626    2565 patch_prober.go:28] interesting pod/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:48:12.930088 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:12.929683    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 16 18:48:13.929452 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:13.929418    2565 patch_prober.go:28] interesting pod/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:48:13.929620 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:13.929470    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 16 18:48:14.929398 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:14.929363    2565 patch_prober.go:28] interesting pod/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:48:14.929794 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:14.929422    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 16 18:48:15.929064 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:15.929027    2565 patch_prober.go:28] interesting pod/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 16 18:48:15.929277 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:15.929092    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 16 18:48:16.934185 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:16.934154    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:48:16.934669 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:16.934540    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:48:16.935173 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:16.935151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:48:28.552360 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.552323    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:48:28.555627 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.555602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.558270 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.558245    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-4dfacb-serving-cert\""
Sep 16 18:48:28.565708 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.565684    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:48:28.598613 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.598592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.598747 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.598672    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.598747 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.598717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.598877 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.598850    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qx64\" (UniqueName: \"kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.700145 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.700117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.700276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.700177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.700276 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.700220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.700392 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.700307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qx64\" (UniqueName: \"kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.701246 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.701223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.703398 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.703345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.704488 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.704460    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.710551 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.710511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qx64\" (UniqueName: \"kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64\") pod \"maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:28.868535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:28.868479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:29.139805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.139781    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:48:29.141926 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:48:29.141866    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5484edc2_1535_467f_bb74_98c643bb4e4e.slice/crio-1b38f956b5b611e1754cfc603bfa6034e4d5ea3def070efec8ff7c2e0127a09c WatchSource:0}: Error finding container 1b38f956b5b611e1754cfc603bfa6034e4d5ea3def070efec8ff7c2e0127a09c: Status 404 returned error can't find the container with id 1b38f956b5b611e1754cfc603bfa6034e4d5ea3def070efec8ff7c2e0127a09c
Sep 16 18:48:29.289465 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.289433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" event={"ID":"5484edc2-1535-467f-bb74-98c643bb4e4e","Type":"ContainerStarted","Data":"1b38f956b5b611e1754cfc603bfa6034e4d5ea3def070efec8ff7c2e0127a09c"}
Sep 16 18:48:29.322942 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.322910    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:48:29.325775 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.325759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.328263 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.328243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4dfacb\""
Sep 16 18:48:29.328374 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.328304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4dfacb-dockercfg-5w8qs\""
Sep 16 18:48:29.341887 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.341865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:48:29.407211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.407156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.407301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.407217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6smq\" (UniqueName: \"kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.508471 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.508433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6smq\" (UniqueName: \"kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.508625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.508540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.509301 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.509272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.516665 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.516642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6smq\" (UniqueName: \"kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq\") pod \"payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.636220 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.636199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:29.909762 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:29.909664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:48:29.912052 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:48:29.912026    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e0ad19_7b8a_4b09_a3f1_afb56735a76f.slice/crio-b0a6e13bbe6cc7b989f512dbb4cfa549152a10f1fc5df0a8c6e3d8971f6a97b2 WatchSource:0}: Error finding container b0a6e13bbe6cc7b989f512dbb4cfa549152a10f1fc5df0a8c6e3d8971f6a97b2: Status 404 returned error can't find the container with id b0a6e13bbe6cc7b989f512dbb4cfa549152a10f1fc5df0a8c6e3d8971f6a97b2
Sep 16 18:48:30.296587 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.296558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" event={"ID":"32e0ad19-7b8a-4b09-a3f1-afb56735a76f","Type":"ContainerStarted","Data":"72531b9adfc968610239e11489dcfd38e741513ed64f7556ba85ba780b8f31bb"}
Sep 16 18:48:30.296763 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.296607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" event={"ID":"32e0ad19-7b8a-4b09-a3f1-afb56735a76f","Type":"ContainerStarted","Data":"b0a6e13bbe6cc7b989f512dbb4cfa549152a10f1fc5df0a8c6e3d8971f6a97b2"}
Sep 16 18:48:30.296763 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.296663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:30.298167 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.298146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" event={"ID":"5484edc2-1535-467f-bb74-98c643bb4e4e","Type":"ContainerStarted","Data":"86390d2ac0bda249c3e67f03dcc76914a9d6918bf9c0424e0cc05140b770ef1c"}
Sep 16 18:48:30.298280 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.298260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:30.316502 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.316462    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" podStartSLOduration=1.316450658 podStartE2EDuration="1.316450658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:48:30.314146896 +0000 UTC m=+1945.006588850" watchObservedRunningTime="2026-09-16 18:48:30.316450658 +0000 UTC m=+1945.008892600"
Sep 16 18:48:30.334640 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:30.334599    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" podStartSLOduration=1.862674305 podStartE2EDuration="2.33458754s" totalImagesPullingTime="471.913235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:48:30.333485133 +0000 UTC m=+1945.025927077" watchObservedRunningTime="2026-09-16 18:48:30.33458754 +0000 UTC m=+1945.027029482"
Sep 16 18:48:36.308850 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:36.308823    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:48:41.305126 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:41.305095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:48:50.466320 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.466288    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:48:50.466782 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.466523    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" podUID="6fe854a7-d091-467b-b6b9-c3bce096cc77" containerName="maas-api" containerID="cri-o://13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a" gracePeriod=30
Sep 16 18:48:50.921200 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.921173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:48:50.991898 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.991873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9kct\" (UniqueName: \"kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct\") pod \"6fe854a7-d091-467b-b6b9-c3bce096cc77\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") "
Sep 16 18:48:50.992039 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.991963    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs\") pod \"6fe854a7-d091-467b-b6b9-c3bce096cc77\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") "
Sep 16 18:48:50.992039 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.991987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls\") pod \"6fe854a7-d091-467b-b6b9-c3bce096cc77\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") "
Sep 16 18:48:50.992128 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.992047    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca\") pod \"6fe854a7-d091-467b-b6b9-c3bce096cc77\" (UID: \"6fe854a7-d091-467b-b6b9-c3bce096cc77\") "
Sep 16 18:48:50.992429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.992402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6fe854a7-d091-467b-b6b9-c3bce096cc77" (UID: "6fe854a7-d091-467b-b6b9-c3bce096cc77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:48:50.993974 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.993948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct" (OuterVolumeSpecName: "kube-api-access-h9kct") pod "6fe854a7-d091-467b-b6b9-c3bce096cc77" (UID: "6fe854a7-d091-467b-b6b9-c3bce096cc77"). InnerVolumeSpecName "kube-api-access-h9kct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:48:50.994064 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.993969    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6fe854a7-d091-467b-b6b9-c3bce096cc77" (UID: "6fe854a7-d091-467b-b6b9-c3bce096cc77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:48:50.994064 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:50.993984    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6fe854a7-d091-467b-b6b9-c3bce096cc77" (UID: "6fe854a7-d091-467b-b6b9-c3bce096cc77"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:48:51.093446 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.093415    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:48:51.093446 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.093444    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6fe854a7-d091-467b-b6b9-c3bce096cc77-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:48:51.093628 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.093457    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe854a7-d091-467b-b6b9-c3bce096cc77-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:48:51.093628 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.093471    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9kct\" (UniqueName: \"kubernetes.io/projected/6fe854a7-d091-467b-b6b9-c3bce096cc77-kube-api-access-h9kct\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:48:51.401660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.401631    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fe854a7-d091-467b-b6b9-c3bce096cc77" containerID="13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a" exitCode=0
Sep 16 18:48:51.401818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.401672    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"
Sep 16 18:48:51.401818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.401707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" event={"ID":"6fe854a7-d091-467b-b6b9-c3bce096cc77","Type":"ContainerDied","Data":"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"}
Sep 16 18:48:51.401818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.401760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz" event={"ID":"6fe854a7-d091-467b-b6b9-c3bce096cc77","Type":"ContainerDied","Data":"b83558ee7ba64db44828e73d4c70afb8dadfccda27d5500588ef3cd849708545"}
Sep 16 18:48:51.401818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.401781    2565 scope.go:117] "RemoveContainer" containerID="13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"
Sep 16 18:48:51.411705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.411690    2565 scope.go:117] "RemoveContainer" containerID="13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"
Sep 16 18:48:51.411967 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:48:51.411945    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a\": container with ID starting with 13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a not found: ID does not exist" containerID="13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"
Sep 16 18:48:51.412029 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.411977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a"} err="failed to get container status \"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a\": rpc error: code = NotFound desc = could not find container \"13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a\": container with ID starting with 13c271e02c8d3caa1d1446a1160a2e815183f9a4d874fd9dbc343682628a510a not found: ID does not exist"
Sep 16 18:48:51.428169 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.428146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:48:51.434252 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.434231    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d8a600-5c88d45c8c-nwbkz"]
Sep 16 18:48:51.739979 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:48:51.739887    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fe854a7-d091-467b-b6b9-c3bce096cc77" path="/var/lib/kubelet/pods/6fe854a7-d091-467b-b6b9-c3bce096cc77/volumes"
Sep 16 18:49:03.883201 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:03.883127    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:49:03.883611 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:03.883333    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" podUID="d3176778-926a-451b-b6cb-dfd0f534024f" containerName="payload-pre-processing" containerID="cri-o://94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b" gracePeriod=30
Sep 16 18:49:04.133482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.133416    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:49:04.210271 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.210236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk8rq\" (UniqueName: \"kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq\") pod \"d3176778-926a-451b-b6cb-dfd0f534024f\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") "
Sep 16 18:49:04.210271 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.210275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume\") pod \"d3176778-926a-451b-b6cb-dfd0f534024f\" (UID: \"d3176778-926a-451b-b6cb-dfd0f534024f\") "
Sep 16 18:49:04.210718 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.210690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3176778-926a-451b-b6cb-dfd0f534024f" (UID: "d3176778-926a-451b-b6cb-dfd0f534024f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:04.212360 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.212331    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq" (OuterVolumeSpecName: "kube-api-access-lk8rq") pod "d3176778-926a-451b-b6cb-dfd0f534024f" (UID: "d3176778-926a-451b-b6cb-dfd0f534024f"). InnerVolumeSpecName "kube-api-access-lk8rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:04.311212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.311182    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk8rq\" (UniqueName: \"kubernetes.io/projected/d3176778-926a-451b-b6cb-dfd0f534024f-kube-api-access-lk8rq\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:04.311212 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.311205    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3176778-926a-451b-b6cb-dfd0f534024f-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:04.465176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.465086    2565 generic.go:356] "Generic (PLEG): container finished" podID="d3176778-926a-451b-b6cb-dfd0f534024f" containerID="94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b" exitCode=0
Sep 16 18:49:04.465176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.465129    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"
Sep 16 18:49:04.465176 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.465136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" event={"ID":"d3176778-926a-451b-b6cb-dfd0f534024f","Type":"ContainerDied","Data":"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"}
Sep 16 18:49:04.465449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.465203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm" event={"ID":"d3176778-926a-451b-b6cb-dfd0f534024f","Type":"ContainerDied","Data":"8319f1e9ed20091d933feb62d76cab787e1ea47309429fee0f9fac8719114859"}
Sep 16 18:49:04.465449 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.465233    2565 scope.go:117] "RemoveContainer" containerID="94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"
Sep 16 18:49:04.474593 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.474577    2565 scope.go:117] "RemoveContainer" containerID="94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"
Sep 16 18:49:04.474871 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:49:04.474852    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b\": container with ID starting with 94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b not found: ID does not exist" containerID="94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"
Sep 16 18:49:04.474984 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.474882    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b"} err="failed to get container status \"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b\": rpc error: code = NotFound desc = could not find container \"94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b\": container with ID starting with 94c54e7d05e821e1280827de80edd6914c07f117b8016ab1c0ed0b875eef156b not found: ID does not exist"
Sep 16 18:49:04.490107 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.490085    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:49:04.495923 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:04.495904    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1f16eb-c95bf7c74-xpksm"]
Sep 16 18:49:05.740492 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:05.740463    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3176778-926a-451b-b6cb-dfd0f534024f" path="/var/lib/kubelet/pods/d3176778-926a-451b-b6cb-dfd0f534024f/volumes"
Sep 16 18:49:11.295598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:11.295567    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:49:11.296067 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:11.295814    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy" containerID="cri-o://e01bf5df8a01e708fc493efdcf13cdc179edc14ce07c8b417443ea1e3ecf46ca" gracePeriod=30
Sep 16 18:49:16.522913 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.522850    2565 generic.go:356] "Generic (PLEG): container finished" podID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerID="e01bf5df8a01e708fc493efdcf13cdc179edc14ce07c8b417443ea1e3ecf46ca" exitCode=0
Sep 16 18:49:16.523380 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.522935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerDied","Data":"e01bf5df8a01e708fc493efdcf13cdc179edc14ce07c8b417443ea1e3ecf46ca"}
Sep 16 18:49:16.523380 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.522996    2565 scope.go:117] "RemoveContainer" containerID="b615f310dee6fc10feb016ec9dcab08e91e47bc863169af70c1521e80f06fc91"
Sep 16 18:49:16.546922 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.546902    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:49:16.610521 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610455    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610521 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610521 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610509    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj7t7\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610771 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610771 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610686    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610771 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610726    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610771 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:16.610993 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610993 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610823    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.610993 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.610859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs\") pod \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\" (UID: \"200cbf15-3de5-4547-acf7-dbfedc44d6f2\") "
Sep 16 18:49:16.611143 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:16.611201 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:16.611409 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:16.611409 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611266    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.611409 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:16.611409 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611411    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.611701 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.611427    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.612818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.612787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7" (OuterVolumeSpecName: "kube-api-access-dj7t7") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "kube-api-access-dj7t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:16.613022 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.613000    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:16.613342 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.613326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:16.613440 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.613420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "200cbf15-3de5-4547-acf7-dbfedc44d6f2" (UID: "200cbf15-3de5-4547-acf7-dbfedc44d6f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:49:16.712247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712227    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.712247 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712245    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.712391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712253    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.712391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712261    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/200cbf15-3de5-4547-acf7-dbfedc44d6f2-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.712391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712269    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/200cbf15-3de5-4547-acf7-dbfedc44d6f2-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:16.712391 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:16.712278    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj7t7\" (UniqueName: \"kubernetes.io/projected/200cbf15-3de5-4547-acf7-dbfedc44d6f2-kube-api-access-dj7t7\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:17.529035 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.529002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"
Sep 16 18:49:17.529488 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.529036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x" event={"ID":"200cbf15-3de5-4547-acf7-dbfedc44d6f2","Type":"ContainerDied","Data":"6180e4c77149dec19213bf71642d09650ebb27afdf7711019c9082c4616cd284"}
Sep 16 18:49:17.529488 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.529091    2565 scope.go:117] "RemoveContainer" containerID="e01bf5df8a01e708fc493efdcf13cdc179edc14ce07c8b417443ea1e3ecf46ca"
Sep 16 18:49:17.572812 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.572781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:49:17.577810 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.577786    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1f16eb-openshift-default-85b889d786-pzb8x"]
Sep 16 18:49:17.739698 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:17.739674    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" path="/var/lib/kubelet/pods/200cbf15-3de5-4547-acf7-dbfedc44d6f2/volumes"
Sep 16 18:49:27.297802 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.297766    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:49:27.298280 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.298021    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" podUID="5484edc2-1535-467f-bb74-98c643bb4e4e" containerName="maas-api" containerID="cri-o://86390d2ac0bda249c3e67f03dcc76914a9d6918bf9c0424e0cc05140b770ef1c" gracePeriod=30
Sep 16 18:49:27.367516 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.367482    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:49:27.367767 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.367737    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" podUID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" containerName="payload-pre-processing" containerID="cri-o://72531b9adfc968610239e11489dcfd38e741513ed64f7556ba85ba780b8f31bb" gracePeriod=30
Sep 16 18:49:27.578704 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.578676    2565 generic.go:356] "Generic (PLEG): container finished" podID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" containerID="72531b9adfc968610239e11489dcfd38e741513ed64f7556ba85ba780b8f31bb" exitCode=0
Sep 16 18:49:27.578847 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.578758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" event={"ID":"32e0ad19-7b8a-4b09-a3f1-afb56735a76f","Type":"ContainerDied","Data":"72531b9adfc968610239e11489dcfd38e741513ed64f7556ba85ba780b8f31bb"}
Sep 16 18:49:27.580492 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.580471    2565 generic.go:356] "Generic (PLEG): container finished" podID="5484edc2-1535-467f-bb74-98c643bb4e4e" containerID="86390d2ac0bda249c3e67f03dcc76914a9d6918bf9c0424e0cc05140b770ef1c" exitCode=0
Sep 16 18:49:27.580598 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.580511    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" event={"ID":"5484edc2-1535-467f-bb74-98c643bb4e4e","Type":"ContainerDied","Data":"86390d2ac0bda249c3e67f03dcc76914a9d6918bf9c0424e0cc05140b770ef1c"}
Sep 16 18:49:27.610225 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.610190    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:49:27.642985 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.642960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:49:27.704720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704696    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qx64\" (UniqueName: \"kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64\") pod \"5484edc2-1535-467f-bb74-98c643bb4e4e\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") "
Sep 16 18:49:27.704720 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704729    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume\") pod \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") "
Sep 16 18:49:27.704906 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704749    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca\") pod \"5484edc2-1535-467f-bb74-98c643bb4e4e\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") "
Sep 16 18:49:27.704906 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls\") pod \"5484edc2-1535-467f-bb74-98c643bb4e4e\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") "
Sep 16 18:49:27.704906 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704845    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6smq\" (UniqueName: \"kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq\") pod \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\" (UID: \"32e0ad19-7b8a-4b09-a3f1-afb56735a76f\") "
Sep 16 18:49:27.704906 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.704882    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs\") pod \"5484edc2-1535-467f-bb74-98c643bb4e4e\" (UID: \"5484edc2-1535-467f-bb74-98c643bb4e4e\") "
Sep 16 18:49:27.705157 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.705118    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "32e0ad19-7b8a-4b09-a3f1-afb56735a76f" (UID: "32e0ad19-7b8a-4b09-a3f1-afb56735a76f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:27.705224 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.705182    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5484edc2-1535-467f-bb74-98c643bb4e4e" (UID: "5484edc2-1535-467f-bb74-98c643bb4e4e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:27.706808 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.706774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5484edc2-1535-467f-bb74-98c643bb4e4e" (UID: "5484edc2-1535-467f-bb74-98c643bb4e4e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:49:27.706931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.706821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq" (OuterVolumeSpecName: "kube-api-access-t6smq") pod "32e0ad19-7b8a-4b09-a3f1-afb56735a76f" (UID: "32e0ad19-7b8a-4b09-a3f1-afb56735a76f"). InnerVolumeSpecName "kube-api-access-t6smq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:27.706931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.706862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64" (OuterVolumeSpecName: "kube-api-access-5qx64") pod "5484edc2-1535-467f-bb74-98c643bb4e4e" (UID: "5484edc2-1535-467f-bb74-98c643bb4e4e"). InnerVolumeSpecName "kube-api-access-5qx64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:27.706931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.706908    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5484edc2-1535-467f-bb74-98c643bb4e4e" (UID: "5484edc2-1535-467f-bb74-98c643bb4e4e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:49:27.805915 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805839    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:27.805915 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805862    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qx64\" (UniqueName: \"kubernetes.io/projected/5484edc2-1535-467f-bb74-98c643bb4e4e-kube-api-access-5qx64\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:27.805915 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805872    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:27.805915 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805882    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5484edc2-1535-467f-bb74-98c643bb4e4e-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:27.805915 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805915    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5484edc2-1535-467f-bb74-98c643bb4e4e-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:27.806139 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:27.805928    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6smq\" (UniqueName: \"kubernetes.io/projected/32e0ad19-7b8a-4b09-a3f1-afb56735a76f-kube-api-access-t6smq\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:28.588555 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.588472    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"
Sep 16 18:49:28.588555 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.588504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p" event={"ID":"32e0ad19-7b8a-4b09-a3f1-afb56735a76f","Type":"ContainerDied","Data":"b0a6e13bbe6cc7b989f512dbb4cfa549152a10f1fc5df0a8c6e3d8971f6a97b2"}
Sep 16 18:49:28.589094 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.588600    2565 scope.go:117] "RemoveContainer" containerID="72531b9adfc968610239e11489dcfd38e741513ed64f7556ba85ba780b8f31bb"
Sep 16 18:49:28.590183 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.590156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv" event={"ID":"5484edc2-1535-467f-bb74-98c643bb4e4e","Type":"ContainerDied","Data":"1b38f956b5b611e1754cfc603bfa6034e4d5ea3def070efec8ff7c2e0127a09c"}
Sep 16 18:49:28.590183 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.590173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"
Sep 16 18:49:28.597814 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.597787    2565 scope.go:117] "RemoveContainer" containerID="86390d2ac0bda249c3e67f03dcc76914a9d6918bf9c0424e0cc05140b770ef1c"
Sep 16 18:49:28.612267 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.612244    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:49:28.623274 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.623250    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-4dfacb-689d46c4d7-5ctgv"]
Sep 16 18:49:28.653512 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.653485    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:49:28.663983 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:28.663962    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-4dfacb-747f67785d-22j9p"]
Sep 16 18:49:29.739501 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:29.739470    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" path="/var/lib/kubelet/pods/32e0ad19-7b8a-4b09-a3f1-afb56735a76f/volumes"
Sep 16 18:49:29.739872 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:29.739854    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5484edc2-1535-467f-bb74-98c643bb4e4e" path="/var/lib/kubelet/pods/5484edc2-1535-467f-bb74-98c643bb4e4e/volumes"
Sep 16 18:49:45.326257 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.326225    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"]
Sep 16 18:49:45.331229 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.331204    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-04899e-29826405-p8mq8"]
Sep 16 18:49:45.354826 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.354796    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:49:45.355144 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.355104    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" podUID="6425d4dd-43ed-4348-be80-3649eed2d5a7" containerName="payload-processing" containerID="cri-o://0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4" gracePeriod=30
Sep 16 18:49:45.601519 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.601492    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:49:45.677851 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.677819    2565 generic.go:356] "Generic (PLEG): container finished" podID="6425d4dd-43ed-4348-be80-3649eed2d5a7" containerID="0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4" exitCode=0
Sep 16 18:49:45.678055 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.677883    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"
Sep 16 18:49:45.678055 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.677934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" event={"ID":"6425d4dd-43ed-4348-be80-3649eed2d5a7","Type":"ContainerDied","Data":"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"}
Sep 16 18:49:45.678055 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.678023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5" event={"ID":"6425d4dd-43ed-4348-be80-3649eed2d5a7","Type":"ContainerDied","Data":"04eef7421fd8b56f9b57ae4dce20070e61abcbc5a765112a8b51096dd745e747"}
Sep 16 18:49:45.678184 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.678067    2565 scope.go:117] "RemoveContainer" containerID="0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"
Sep 16 18:49:45.688609 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.688587    2565 scope.go:117] "RemoveContainer" containerID="0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"
Sep 16 18:49:45.688974 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:49:45.688951    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4\": container with ID starting with 0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4 not found: ID does not exist" containerID="0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"
Sep 16 18:49:45.689078 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.688983    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4"} err="failed to get container status \"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4\": rpc error: code = NotFound desc = could not find container \"0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4\": container with ID starting with 0c68ad18470070539e7494d0279497d4a0a53c772782e3b503ca2d251dd9f4a4 not found: ID does not exist"
Sep 16 18:49:45.740307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.740277    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1bbd1de-36da-47ce-8b65-cbd137907d80" path="/var/lib/kubelet/pods/b1bbd1de-36da-47ce-8b65-cbd137907d80/volumes"
Sep 16 18:49:45.752378 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.752351    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f5zd\" (UniqueName: \"kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd\") pod \"6425d4dd-43ed-4348-be80-3649eed2d5a7\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") "
Sep 16 18:49:45.752482 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.752467    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume\") pod \"6425d4dd-43ed-4348-be80-3649eed2d5a7\" (UID: \"6425d4dd-43ed-4348-be80-3649eed2d5a7\") "
Sep 16 18:49:45.752798 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.752779    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6425d4dd-43ed-4348-be80-3649eed2d5a7" (UID: "6425d4dd-43ed-4348-be80-3649eed2d5a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:45.754393 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.754364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd" (OuterVolumeSpecName: "kube-api-access-6f5zd") pod "6425d4dd-43ed-4348-be80-3649eed2d5a7" (UID: "6425d4dd-43ed-4348-be80-3649eed2d5a7"). InnerVolumeSpecName "kube-api-access-6f5zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:45.853474 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.853409    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f5zd\" (UniqueName: \"kubernetes.io/projected/6425d4dd-43ed-4348-be80-3649eed2d5a7-kube-api-access-6f5zd\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:45.853474 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:45.853434    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6425d4dd-43ed-4348-be80-3649eed2d5a7-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:46.000116 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:46.000088    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:49:46.010033 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:46.010006    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-04899e-577ff94d7f-8gwn5"]
Sep 16 18:49:47.739024 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:47.738992    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6425d4dd-43ed-4348-be80-3649eed2d5a7" path="/var/lib/kubelet/pods/6425d4dd-43ed-4348-be80-3649eed2d5a7/volumes"
Sep 16 18:49:52.946673 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:52.946617    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:49:52.947101 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:52.946857    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy" containerID="cri-o://7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f" gracePeriod=30
Sep 16 18:49:58.193395 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.193369    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:49:58.248419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248395    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248419 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248434    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248461    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248508    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248653 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248619    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp46r\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r\") pod \"7f586e74-6e19-4926-978c-7cc641e4bf67\" (UID: \"7f586e74-6e19-4926-978c-7cc641e4bf67\") "
Sep 16 18:49:58.248987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248679    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:58.248987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248724    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:58.248987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:58.248987 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248973    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-credential-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.249156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.248995    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.249156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.249012    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:58.249156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.249041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:49:58.250568 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.250548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:58.250673 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.250569    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 18:49:58.251066 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.251033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 18:49:58.251156 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.251051    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r" (OuterVolumeSpecName: "kube-api-access-xp46r") pod "7f586e74-6e19-4926-978c-7cc641e4bf67" (UID: "7f586e74-6e19-4926-978c-7cc641e4bf67"). InnerVolumeSpecName "kube-api-access-xp46r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:49:58.349535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349513    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f586e74-6e19-4926-978c-7cc641e4bf67-istiod-ca-cert\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349535 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349533    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp46r\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-kube-api-access-xp46r\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349543    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-token\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349552    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-envoy\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349562    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-data\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349570    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f586e74-6e19-4926-978c-7cc641e4bf67-istio-podinfo\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.349660 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.349577    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f586e74-6e19-4926-978c-7cc641e4bf67-workload-socket\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:49:58.741030 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.741001    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerID="7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f" exitCode=0
Sep 16 18:49:58.741166 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.741041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"
Sep 16 18:49:58.741166 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.741047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerDied","Data":"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"}
Sep 16 18:49:58.741166 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.741092    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5" event={"ID":"7f586e74-6e19-4926-978c-7cc641e4bf67","Type":"ContainerDied","Data":"8066a8ecbaacbfd18a6f811515678b82b356ac41aa4b0363591221398f6e0d32"}
Sep 16 18:49:58.741166 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.741118    2565 scope.go:117] "RemoveContainer" containerID="7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"
Sep 16 18:49:58.750197 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.750177    2565 scope.go:117] "RemoveContainer" containerID="4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"
Sep 16 18:49:58.758154 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.758136    2565 scope.go:117] "RemoveContainer" containerID="7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"
Sep 16 18:49:58.758422 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:49:58.758405    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f\": container with ID starting with 7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f not found: ID does not exist" containerID="7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"
Sep 16 18:49:58.758497 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.758431    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f"} err="failed to get container status \"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f\": rpc error: code = NotFound desc = could not find container \"7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f\": container with ID starting with 7879621d5c31009b284cd9bbcba899ebd87632d532a2c19e524f8cb92b5a501f not found: ID does not exist"
Sep 16 18:49:58.758497 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.758454    2565 scope.go:117] "RemoveContainer" containerID="4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"
Sep 16 18:49:58.758727 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:49:58.758709    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5\": container with ID starting with 4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5 not found: ID does not exist" containerID="4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"
Sep 16 18:49:58.758764 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.758733    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5"} err="failed to get container status \"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5\": rpc error: code = NotFound desc = could not find container \"4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5\": container with ID starting with 4eafab3a6a15df77a13fe138798680b2fc8acf674d8d26162060083bfcd16fe5 not found: ID does not exist"
Sep 16 18:49:58.765429 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.765409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:49:58.772190 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:58.772162    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-04899e-openshift-default-5c7d579844-tpcz5"]
Sep 16 18:49:59.739839 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:49:59.739805    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" path="/var/lib/kubelet/pods/7f586e74-6e19-4926-978c-7cc641e4bf67/volumes"
Sep 16 18:50:03.837435 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:03.837403    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:50:03.838076 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:03.837676    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" podUID="28ecc79e-79ab-4d31-9739-dc366fb2abde" containerName="payload-processing" containerID="cri-o://158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d" gracePeriod=30
Sep 16 18:50:04.081402 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.081374    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:50:04.091047 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.090990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cbmr\" (UniqueName: \"kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr\") pod \"28ecc79e-79ab-4d31-9739-dc366fb2abde\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") "
Sep 16 18:50:04.091047 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.091027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume\") pod \"28ecc79e-79ab-4d31-9739-dc366fb2abde\" (UID: \"28ecc79e-79ab-4d31-9739-dc366fb2abde\") "
Sep 16 18:50:04.091421 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.091397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28ecc79e-79ab-4d31-9739-dc366fb2abde" (UID: "28ecc79e-79ab-4d31-9739-dc366fb2abde"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:50:04.092961 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.092942    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr" (OuterVolumeSpecName: "kube-api-access-4cbmr") pod "28ecc79e-79ab-4d31-9739-dc366fb2abde" (UID: "28ecc79e-79ab-4d31-9739-dc366fb2abde"). InnerVolumeSpecName "kube-api-access-4cbmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:50:04.192336 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.192299    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cbmr\" (UniqueName: \"kubernetes.io/projected/28ecc79e-79ab-4d31-9739-dc366fb2abde-kube-api-access-4cbmr\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:50:04.192336 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.192328    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28ecc79e-79ab-4d31-9739-dc366fb2abde-plugins-config-volume\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:50:04.772612 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.772577    2565 generic.go:356] "Generic (PLEG): container finished" podID="28ecc79e-79ab-4d31-9739-dc366fb2abde" containerID="158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d" exitCode=0
Sep 16 18:50:04.772818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.772628    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"
Sep 16 18:50:04.772818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.772656    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" event={"ID":"28ecc79e-79ab-4d31-9739-dc366fb2abde","Type":"ContainerDied","Data":"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"}
Sep 16 18:50:04.772818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.772719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f" event={"ID":"28ecc79e-79ab-4d31-9739-dc366fb2abde","Type":"ContainerDied","Data":"f4cc3f686eb4f5a02397b04905eeb2007db6ff4077b2fd414f9060f44a787db9"}
Sep 16 18:50:04.772818 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.772740    2565 scope.go:117] "RemoveContainer" containerID="158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"
Sep 16 18:50:04.781304 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.781286    2565 scope.go:117] "RemoveContainer" containerID="158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"
Sep 16 18:50:04.781577 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:50:04.781555    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d\": container with ID starting with 158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d not found: ID does not exist" containerID="158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"
Sep 16 18:50:04.781625 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.781586    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d"} err="failed to get container status \"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d\": rpc error: code = NotFound desc = could not find container \"158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d\": container with ID starting with 158f5e897eee3251b153a6856e32a2319a9fc0c92d426c38bcbc45336974b73d not found: ID does not exist"
Sep 16 18:50:04.794913 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.794877    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:50:04.799216 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:04.799196    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-520999-759594459-bbj6f"]
Sep 16 18:50:05.740108 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:50:05.740072    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28ecc79e-79ab-4d31-9739-dc366fb2abde" path="/var/lib/kubelet/pods/28ecc79e-79ab-4d31-9739-dc366fb2abde/volumes"
Sep 16 18:51:05.968189 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:51:05.968158    2565 scope.go:117] "RemoveContainer" containerID="239e0bf7b2b061d47abcac47b5dc431a12bfcb2eddc4b659f32ac31ed9b7c116"
Sep 16 18:51:05.975662 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:51:05.975642    2565 scope.go:117] "RemoveContainer" containerID="6ab0659a5f7e7cf5fd558fa3d33353583a1e09bfc6f895cf17bacead695b27b3"
Sep 16 18:56:08.109289 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109247    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"]
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109556    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109567    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109578    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109584    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109590    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109604    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6425d4dd-43ed-4348-be80-3649eed2d5a7" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109609    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6425d4dd-43ed-4348-be80-3649eed2d5a7" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109615    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28ecc79e-79ab-4d31-9739-dc366fb2abde" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109620    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="28ecc79e-79ab-4d31-9739-dc366fb2abde" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109627    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109631    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109637    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5484edc2-1535-467f-bb74-98c643bb4e4e" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109641    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5484edc2-1535-467f-bb74-98c643bb4e4e" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109648    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3176778-926a-451b-b6cb-dfd0f534024f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109653    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3176778-926a-451b-b6cb-dfd0f534024f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109659    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109664    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109671    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe854a7-d091-467b-b6b9-c3bce096cc77" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109676    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe854a7-d091-467b-b6b9-c3bce096cc77" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109725    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e0ad19-7b8a-4b09-a3f1-afb56735a76f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109733    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109738    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="28ecc79e-79ab-4d31-9739-dc366fb2abde" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe854a7-d091-467b-b6b9-c3bce096cc77" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109752    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3176778-926a-451b-b6cb-dfd0f534024f" containerName="payload-pre-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109757    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5484edc2-1535-467f-bb74-98c643bb4e4e" containerName="maas-api"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109762    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109768    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f586e74-6e19-4926-978c-7cc641e4bf67" containerName="istio-proxy"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109772    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6425d4dd-43ed-4348-be80-3649eed2d5a7" containerName="payload-processing"
Sep 16 18:56:08.109945 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.109777    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="200cbf15-3de5-4547-acf7-dbfedc44d6f2" containerName="istio-proxy"
Sep 16 18:56:08.113340 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.113317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.126682 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.126657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"]
Sep 16 18:56:08.153509 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.153480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9272d76-7684-4334-af7d-f2a8fa525e71-openshift-service-ca\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.153623 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.153518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-metrics-certs\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.153623 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.153555    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-maas-api-tls\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.153708 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.153657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjxtf\" (UniqueName: \"kubernetes.io/projected/d9272d76-7684-4334-af7d-f2a8fa525e71-kube-api-access-tjxtf\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.254520 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.254495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjxtf\" (UniqueName: \"kubernetes.io/projected/d9272d76-7684-4334-af7d-f2a8fa525e71-kube-api-access-tjxtf\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.254624 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.254530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9272d76-7684-4334-af7d-f2a8fa525e71-openshift-service-ca\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.254624 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.254550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-metrics-certs\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.254624 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.254570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-maas-api-tls\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.255188 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.255166    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9272d76-7684-4334-af7d-f2a8fa525e71-openshift-service-ca\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.257044 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.257026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-maas-api-tls\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.257196 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.257176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d9272d76-7684-4334-af7d-f2a8fa525e71-metrics-certs\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.262573 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.262552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjxtf\" (UniqueName: \"kubernetes.io/projected/d9272d76-7684-4334-af7d-f2a8fa525e71-kube-api-access-tjxtf\") pod \"maas-api-75c7469999-f5kx7\" (UID: \"d9272d76-7684-4334-af7d-f2a8fa525e71\") " pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.423416 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.423351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:08.690615 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.690548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"]
Sep 16 18:56:08.694083 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:56:08.694056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9272d76_7684_4334_af7d_f2a8fa525e71.slice/crio-5bfb979df61609fc9d0da85776bf096c038ff194b2c4ecd481540cccec60969d WatchSource:0}: Error finding container 5bfb979df61609fc9d0da85776bf096c038ff194b2c4ecd481540cccec60969d: Status 404 returned error can't find the container with id 5bfb979df61609fc9d0da85776bf096c038ff194b2c4ecd481540cccec60969d
Sep 16 18:56:08.695879 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:08.695859    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 18:56:09.314940 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:09.314910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7" event={"ID":"d9272d76-7684-4334-af7d-f2a8fa525e71","Type":"ContainerStarted","Data":"f21fdd0c2bc861e05189d62f1bc6adfea63441e1eb16038650daf557210c7780"}
Sep 16 18:56:09.315285 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:09.314960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7" event={"ID":"d9272d76-7684-4334-af7d-f2a8fa525e71","Type":"ContainerStarted","Data":"5bfb979df61609fc9d0da85776bf096c038ff194b2c4ecd481540cccec60969d"}
Sep 16 18:56:09.315285 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:09.315018    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:09.338547 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:09.338501    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7" podStartSLOduration=1.015138505 podStartE2EDuration="1.33848759s" totalImagesPullingTime="323.349085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 18:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:56:09.337554946 +0000 UTC m=+2404.029996901" watchObservedRunningTime="2026-09-16 18:56:09.33848759 +0000 UTC m=+2404.030929531"
Sep 16 18:56:15.323842 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:15.323811    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75c7469999-f5kx7"
Sep 16 18:56:15.381307 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:15.381276    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:56:15.381498 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:15.381471    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" podUID="4c7aa513-f7bf-4f82-8131-72491ab2065a" containerName="maas-api" containerID="cri-o://23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db" gracePeriod=30
Sep 16 18:56:16.621349 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.621322    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:56:16.721094 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721010    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls\") pod \"4c7aa513-f7bf-4f82-8131-72491ab2065a\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") "
Sep 16 18:56:16.721094 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721084    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca\") pod \"4c7aa513-f7bf-4f82-8131-72491ab2065a\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") "
Sep 16 18:56:16.721314 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721125    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs\") pod \"4c7aa513-f7bf-4f82-8131-72491ab2065a\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") "
Sep 16 18:56:16.721314 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721271    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdv2g\" (UniqueName: \"kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g\") pod \"4c7aa513-f7bf-4f82-8131-72491ab2065a\" (UID: \"4c7aa513-f7bf-4f82-8131-72491ab2065a\") "
Sep 16 18:56:16.721504 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721472    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4c7aa513-f7bf-4f82-8131-72491ab2065a" (UID: "4c7aa513-f7bf-4f82-8131-72491ab2065a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 18:56:16.721610 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.721548    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c7aa513-f7bf-4f82-8131-72491ab2065a-openshift-service-ca\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:56:16.723127 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.723101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4c7aa513-f7bf-4f82-8131-72491ab2065a" (UID: "4c7aa513-f7bf-4f82-8131-72491ab2065a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:56:16.723230 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.723119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4c7aa513-f7bf-4f82-8131-72491ab2065a" (UID: "4c7aa513-f7bf-4f82-8131-72491ab2065a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 18:56:16.723230 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.723156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g" (OuterVolumeSpecName: "kube-api-access-qdv2g") pod "4c7aa513-f7bf-4f82-8131-72491ab2065a" (UID: "4c7aa513-f7bf-4f82-8131-72491ab2065a"). InnerVolumeSpecName "kube-api-access-qdv2g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 18:56:16.822070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.822046    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdv2g\" (UniqueName: \"kubernetes.io/projected/4c7aa513-f7bf-4f82-8131-72491ab2065a-kube-api-access-qdv2g\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:56:16.822070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.822067    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-maas-api-tls\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:56:16.822197 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:16.822076    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c7aa513-f7bf-4f82-8131-72491ab2065a-metrics-certs\") on node \"ip-10-0-142-63.ec2.internal\" DevicePath \"\""
Sep 16 18:56:17.352037 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.352003    2565 generic.go:356] "Generic (PLEG): container finished" podID="4c7aa513-f7bf-4f82-8131-72491ab2065a" containerID="23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db" exitCode=0
Sep 16 18:56:17.352211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.352057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"
Sep 16 18:56:17.352211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.352070    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" event={"ID":"4c7aa513-f7bf-4f82-8131-72491ab2065a","Type":"ContainerDied","Data":"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"}
Sep 16 18:56:17.352211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.352113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd" event={"ID":"4c7aa513-f7bf-4f82-8131-72491ab2065a","Type":"ContainerDied","Data":"adb5ad85395479d7587f7484db2806ccaf229358b070d0a274701fcdaa764dde"}
Sep 16 18:56:17.352211 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.352135    2565 scope.go:117] "RemoveContainer" containerID="23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"
Sep 16 18:56:17.361098 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.361026    2565 scope.go:117] "RemoveContainer" containerID="23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"
Sep 16 18:56:17.361316 ip-10-0-142-63 kubenswrapper[2565]: E0916 18:56:17.361300    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db\": container with ID starting with 23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db not found: ID does not exist" containerID="23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"
Sep 16 18:56:17.361364 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.361327    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db"} err="failed to get container status \"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db\": rpc error: code = NotFound desc = could not find container \"23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db\": container with ID starting with 23cd18f970e80c69517554aa0a9b95790c44083a35852ed98e81f36576e6b8db not found: ID does not exist"
Sep 16 18:56:17.384774 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.384747    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:56:17.389758 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.389735    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6ddb7ffb7f-ds6wd"]
Sep 16 18:56:17.740335 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:17.740254    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c7aa513-f7bf-4f82-8131-72491ab2065a" path="/var/lib/kubelet/pods/4c7aa513-f7bf-4f82-8131-72491ab2065a/volumes"
Sep 16 18:56:35.761060 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:35.760987    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lwdmj_335bac9d-f7c2-4fa4-9701-31308b3c3ab6/server/0.log"
Sep 16 18:56:35.885052 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:35.885022    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f5pml_3471ff75-b394-4edc-877c-11627452afcc/manager/0.log"
Sep 16 18:56:36.265817 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:36.265792    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj_74956e3a-f2a6-4335-869f-44774ba09604/copy-manifests/0.log"
Sep 16 18:56:36.283086 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:36.283061    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj_74956e3a-f2a6-4335-869f-44774ba09604/manager/0.log"
Sep 16 18:56:36.706908 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:36.706872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75c7469999-f5kx7_d9272d76-7684-4334-af7d-f2a8fa525e71/maas-api/0.log"
Sep 16 18:56:39.132902 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:39.132858    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-476rf_b12cdc12-62a9-4da1-9f4f-996f1dc59dd1/discovery/0.log"
Sep 16 18:56:39.617438 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:39.617411    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kxd7h_20490f9a-8a82-43ab-b4f4-c937ec0e4d9b/payload-pre-processing/0.log"
Sep 16 18:56:40.343331 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:40.343299    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jnxk7_b450d28d-12b8-4e1b-b4ae-1c647bf9413c/main/0.log"
Sep 16 18:56:40.584112 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:40.584084    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-m7w4z_a91b27a7-47b1-4dbe-93dd-b16bb3a820b1/main/0.log"
Sep 16 18:56:40.819352 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:40.819324    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mt2cg_3ed0cfe6-1d44-4ecd-86d2-9b95578db070/main/0.log"
Sep 16 18:56:49.907861 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:49.907827    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fk6hk_3dd21bfe-b9e2-4341-9418-ce343fffdde5/global-pull-secret-syncer/0.log"
Sep 16 18:56:50.110902 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:50.110874    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-whnw5_fd41f1ac-1ced-4098-a684-57758bb51da6/konnectivity-agent/0.log"
Sep 16 18:56:50.182191 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:50.182132    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-63.ec2.internal_a342c85daba9b5e3dc23662ea15815c7/haproxy/0.log"
Sep 16 18:56:57.178263 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:57.178234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpmvf_7b6f0e32-e66f-4b9b-8307-5a7de2342473/node-exporter/0.log"
Sep 16 18:56:57.206989 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:57.206963    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpmvf_7b6f0e32-e66f-4b9b-8307-5a7de2342473/kube-rbac-proxy/0.log"
Sep 16 18:56:57.229347 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:57.229323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lpmvf_7b6f0e32-e66f-4b9b-8307-5a7de2342473/init-textfile/0.log"
Sep 16 18:56:59.350803 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:56:59.350769    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-5ztrg_acc0d164-61fa-443b-9e4e-2d16953d834b/networking-console-plugin/0.log"
Sep 16 18:57:00.831806 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.831773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"]
Sep 16 18:57:00.832192 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.832089    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c7aa513-f7bf-4f82-8131-72491ab2065a" containerName="maas-api"
Sep 16 18:57:00.832192 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.832100    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c7aa513-f7bf-4f82-8131-72491ab2065a" containerName="maas-api"
Sep 16 18:57:00.832192 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.832162    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c7aa513-f7bf-4f82-8131-72491ab2065a" containerName="maas-api"
Sep 16 18:57:00.835155 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.835139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:00.839070 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.839051    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pncdd\"/\"default-dockercfg-5668f\""
Sep 16 18:57:00.840190 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.840171    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pncdd\"/\"openshift-service-ca.crt\""
Sep 16 18:57:00.840288 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.840189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pncdd\"/\"kube-root-ca.crt\""
Sep 16 18:57:00.855526 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.855503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"]
Sep 16 18:57:00.959580 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.959550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-sys\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:00.959705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.959600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-proc\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:00.959705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.959646    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-lib-modules\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:00.959705 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.959670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmqbx\" (UniqueName: \"kubernetes.io/projected/057de4d8-bf19-40bb-b9a1-d0176a62cefd-kube-api-access-vmqbx\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:00.959809 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:00.959774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-podres\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060213 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-podres\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-sys\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-proc\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-lib-modules\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060317 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmqbx\" (UniqueName: \"kubernetes.io/projected/057de4d8-bf19-40bb-b9a1-d0176a62cefd-kube-api-access-vmqbx\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-sys\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-proc\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-podres\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.060459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.060435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/057de4d8-bf19-40bb-b9a1-d0176a62cefd-lib-modules\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.069990 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.069958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmqbx\" (UniqueName: \"kubernetes.io/projected/057de4d8-bf19-40bb-b9a1-d0176a62cefd-kube-api-access-vmqbx\") pod \"perf-node-gather-daemonset-c7sj4\" (UID: \"057de4d8-bf19-40bb-b9a1-d0176a62cefd\") " pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.144447 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.144393    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:01.436921 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.436884    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"]
Sep 16 18:57:01.439267 ip-10-0-142-63 kubenswrapper[2565]: W0916 18:57:01.439246    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod057de4d8_bf19_40bb_b9a1_d0176a62cefd.slice/crio-f6b5637a7d142394dc506cdfce6eaaac75fd6d9755c8c3eb9113d7c89f889630 WatchSource:0}: Error finding container f6b5637a7d142394dc506cdfce6eaaac75fd6d9755c8c3eb9113d7c89f889630: Status 404 returned error can't find the container with id f6b5637a7d142394dc506cdfce6eaaac75fd6d9755c8c3eb9113d7c89f889630
Sep 16 18:57:01.540936 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:01.540904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4" event={"ID":"057de4d8-bf19-40bb-b9a1-d0176a62cefd","Type":"ContainerStarted","Data":"f6b5637a7d142394dc506cdfce6eaaac75fd6d9755c8c3eb9113d7c89f889630"}
Sep 16 18:57:02.547119 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:02.547079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4" event={"ID":"057de4d8-bf19-40bb-b9a1-d0176a62cefd","Type":"ContainerStarted","Data":"1a50fc3ee8c72a103fbd7997f848847cb5929dba43c6ec0b10eba7266514e75e"}
Sep 16 18:57:02.547566 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:02.547208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:02.570569 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:02.570514    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4" podStartSLOduration=2.570499438 podStartE2EDuration="2.570499438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 18:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 18:57:02.569516073 +0000 UTC m=+2457.261958028" watchObservedRunningTime="2026-09-16 18:57:02.570499438 +0000 UTC m=+2457.262941380"
Sep 16 18:57:02.985325 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:02.985243    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vc6x_1bbdf0fb-9360-4de9-8885-bad6c1db8981/dns/0.log"
Sep 16 18:57:03.008459 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:03.008427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vc6x_1bbdf0fb-9360-4de9-8885-bad6c1db8981/kube-rbac-proxy/0.log"
Sep 16 18:57:03.158791 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:03.158760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vfqgt_2905bca1-f05e-48f2-9ddc-7647d23697ad/dns-node-resolver/0.log"
Sep 16 18:57:03.845292 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:03.845263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7875c945d7-nfrvz_329fa8ee-f426-4de5-8b9a-c1dd3f1a7271/registry/0.log"
Sep 16 18:57:03.902742 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:03.902713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hlc67_048e8704-f130-4dc6-8eca-efc9f2d6efd7/node-ca/0.log"
Sep 16 18:57:05.342520 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:05.342487    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-476rf_b12cdc12-62a9-4da1-9f4f-996f1dc59dd1/discovery/0.log"
Sep 16 18:57:05.460296 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:05.460255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kxd7h_20490f9a-8a82-43ab-b4f4-c937ec0e4d9b/payload-pre-processing/0.log"
Sep 16 18:57:06.484931 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:06.484885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-99hj9_da24c96b-7b67-4bbf-8512-2b5b0ae95881/serve-healthcheck-canary/0.log"
Sep 16 18:57:07.118642 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:07.118611    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mp2c_ada9ea00-a678-441e-be1d-efed67d92ffb/kube-rbac-proxy/0.log"
Sep 16 18:57:07.146237 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:07.146205    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mp2c_ada9ea00-a678-441e-be1d-efed67d92ffb/exporter/0.log"
Sep 16 18:57:07.172332 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:07.172307    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mp2c_ada9ea00-a678-441e-be1d-efed67d92ffb/extractor/0.log"
Sep 16 18:57:08.561938 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:08.561888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pncdd/perf-node-gather-daemonset-c7sj4"
Sep 16 18:57:10.294177 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:10.294148    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lwdmj_335bac9d-f7c2-4fa4-9701-31308b3c3ab6/server/0.log"
Sep 16 18:57:10.378777 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:10.378754    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-f5pml_3471ff75-b394-4edc-877c-11627452afcc/manager/0.log"
Sep 16 18:57:10.584959 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:10.584934    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj_74956e3a-f2a6-4335-869f-44774ba09604/manager/0.log"
Sep 16 18:57:10.612314 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:10.612291    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cfd5c8dfd-z2cnj_74956e3a-f2a6-4335-869f-44774ba09604/copy-manifests/0.log"
Sep 16 18:57:11.746977 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:11.746943    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-476rf_b12cdc12-62a9-4da1-9f4f-996f1dc59dd1/discovery/0.log"
Sep 16 18:57:11.861917 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:11.861817    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kxd7h_20490f9a-8a82-43ab-b4f4-c937ec0e4d9b/payload-pre-processing/0.log"
Sep 16 18:57:11.943140 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:11.943114    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5555c8c497-9r2gp_c2267c76-3d0d-41f2-b3e4-7468d77844c8/manager/0.log"
Sep 16 18:57:13.971805 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:13.971774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-476rf_b12cdc12-62a9-4da1-9f4f-996f1dc59dd1/discovery/0.log"
Sep 16 18:57:14.061577 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:14.061554    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kxd7h_20490f9a-8a82-43ab-b4f4-c937ec0e4d9b/payload-pre-processing/0.log"
Sep 16 18:57:17.915466 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:17.915438    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-sghbd_2ab1d218-8574-4496-9b83-6ce975e1d991/migrator/0.log"
Sep 16 18:57:17.944423 ip-10-0-142-63 kubenswrapper[2565]: I0916 18:57:17.944400    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-sghbd_2ab1d218-8574-4496-9b83-6ce975e1d991/graceful-termination/0.log"