Sep 18 17:12:33.048004 ip-10-0-135-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 18 17:12:33.048016 ip-10-0-135-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 18 17:12:33.048023 ip-10-0-135-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 18 17:12:33.048250 ip-10-0-135-187 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 18 17:12:43.171493 ip-10-0-135-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 18 17:12:43.171537 ip-10-0-135-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 46664d2e5b7a4233991748d851af7110 --
Sep 18 17:14:27.944391 ip-10-0-135-187 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 17:14:28.315735 ip-10-0-135-187 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 17:14:28.315735 ip-10-0-135-187 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 17:14:28.315735 ip-10-0-135-187 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 17:14:28.315735 ip-10-0-135-187 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 17:14:28.315735 ip-10-0-135-187 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 17:14:28.317977 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.317902    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 17:14:28.324618 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324600    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.324618 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324616    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.324618 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324620    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324624    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324627    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324629    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324632    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324635    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324637    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324641    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324645    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324648    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324658    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324661    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324664    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324666    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324669    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324672    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324674    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324677    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324679    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.324710 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324682    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324686    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324688    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324691    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324694    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324696    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324700    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324704    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324712    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324715    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324718    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324722    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324725    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324728    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324730    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324733    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324735    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324738    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324741    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.325199 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324743    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324746    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324748    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324751    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324753    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324755    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324758    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324760    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324763    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324765    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324767    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324770    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324772    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324776    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324780    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324783    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324786    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324790    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324793    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324796    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.325663 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324798    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324801    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324804    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324807    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324810    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324812    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324815    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324817    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324820    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324823    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324826    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324829    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324831    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324833    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324836    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324838    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324841    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324843    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324845    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324848    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.326161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324851    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324853    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324855    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324858    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324860    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324864    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324866    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324869    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324871    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324874    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324876    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324879    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324881    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324884    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324886    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324889    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324891    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324893    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.324896    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325591    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.326658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325598    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325603    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325607    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325610    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325615    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325618    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325621    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325623    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325626    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325629    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325631    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325634    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325637    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325639    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325642    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325645    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325647    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325650    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325653    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325656    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.327170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325659    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325661    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325664    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325667    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325669    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325672    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325675    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325677    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325680    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325682    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325685    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325688    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325690    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325693    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325697    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325701    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325704    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325707    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325710    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.327676 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325712    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325715    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325717    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325720    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325723    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325726    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325729    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325732    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325734    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325737    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325739    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325741    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325744    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325746    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325749    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325751    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325754    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325756    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325760    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.328159 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325765    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325767    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325770    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325772    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325775    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325777    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325780    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325782    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325785    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325787    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325789    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325792    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325795    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325797    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325800    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325802    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325805    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325808    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325810    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325813    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.328630 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325815    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325818    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325821    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325823    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325825    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325828    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325831    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325833    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325836    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325838    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325841    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325843    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325846    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325848    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325850    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325853    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325855    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325858    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325860    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.325863    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.329161 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326231    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326236    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326239    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326242    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326245    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326248    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326251    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326253    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326256    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326259    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326262    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326265    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326267    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326270    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326272    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326275    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326278    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326280    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326283    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326285    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.329658 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326288    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326290    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326293    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326295    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326298    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326301    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326303    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326306    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326308    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326310    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326313    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326315    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326318    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326320    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326323    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326326    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326329    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326333    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326337    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.330175 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326341    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326344    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326346    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326349    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326352    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326354    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326357    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326359    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326362    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326364    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326367    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326369    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326371    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326374    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326376    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326379    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326381    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326383    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326387    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.330668 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326391    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326394    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326397    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326400    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326402    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326405    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326407    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326410    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326412    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326415    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326417    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326420    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326423    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326426    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326428    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326434    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326436    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326439    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326441    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326444    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.331208 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326446    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326449    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326452    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326454    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326456    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326459    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326462    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326464    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326467    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326469    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326472    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326474    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326477    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326479    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326482    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326484    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326486    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326489    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326491    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326495    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.331732 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.326498    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326571    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326600    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326607    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326612    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326617    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326620    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326625    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326630    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326633    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326636    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326639    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326643    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326646    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326649    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326651    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326654    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326657    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326660    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326664    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326667    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326670    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326673    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326676    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 17:14:28.332270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326680    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326683    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326686    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326689    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326692    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326695    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326698    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326702    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326705    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326708    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326711    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326714    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326717    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326720    2584 flags.go:64] FLAG: --enable-server="true"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326723    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326728    2584 flags.go:64] FLAG: --event-burst="100"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326731    2584 flags.go:64] FLAG: --event-qps="50"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326734    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326737    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326740    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326743    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326746    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326749    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326752    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326754    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 17:14:28.332841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326757    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326760    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326774    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326777    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326780    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326782    2584 flags.go:64] FLAG: --feature-gates=""
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326786    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326789    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326792    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326795    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326798    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326801    2584 flags.go:64] FLAG: --help="false"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326804    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326806    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326811    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326813    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326817    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326820    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326823    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326825    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326828    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326832    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326837    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326841    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 17:14:28.333516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326843    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326846    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326849    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326852    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326854    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326857    2584 flags.go:64] FLAG: --lock-file=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326860    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326863    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326866    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326871    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326873    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326876    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326878    2584 flags.go:64] FLAG: --logging-format="text"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326881    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326884    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326887    2584 flags.go:64] FLAG: --manifest-url=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326890    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326894    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326897    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326901    2584 flags.go:64] FLAG: --max-pods="110"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326904    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326907    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326911    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326914    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326917    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 17:14:28.334201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326920    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326923    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326929    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326932    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326935    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326940    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326943    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326949    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326952    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326955    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326958    2584 flags.go:64] FLAG: --port="10250"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326961    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326963    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d962926fa2f369d3"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326966    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326969    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326972    2584 flags.go:64] FLAG: --register-node="true"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326975    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326978    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326981    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326984    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326987    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326990    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326994    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326996    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.326999    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 17:14:28.334822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327002    2584 flags.go:64] FLAG: --runonce="false"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327005    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327008    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327011    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327014    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327017    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327020    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327023    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327026    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327029    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327031    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327034    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327037    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327041    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327044    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327047    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327052    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327055    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327058    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327061    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327064    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327066    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327069    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327072    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327074    2584 flags.go:64] FLAG: --v="2"
Sep 18 17:14:28.335456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327078    2584 flags.go:64] FLAG: --version="false"
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327082    2584 flags.go:64] FLAG: --vmodule=""
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327085    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.327088    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327218    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327222    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327225    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327228    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327231    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327234    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327237    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327241    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327244    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327247    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327250    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327252    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327255    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327257    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327260    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327262    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.336086 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327266    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327269    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327272    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327275    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327277    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327280    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327282    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327285    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327289    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327291    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327294    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327296    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327299    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327301    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327304    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327306    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327309    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327311    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327314    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327316    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.336606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327319    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327321    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327324    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327327    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327330    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327332    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327335    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327337    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327340    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327344    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327347    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327350    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327354    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327357    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327359    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327363    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327366    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327369    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327371    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.337186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327374    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327376    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327380    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327383    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327386    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327389    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327392    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327395    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327397    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327400    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327418    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327423    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327426    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327429    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327431    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327434    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327438    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327440    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327443    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.337938 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327445    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327448    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327451    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327453    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327455    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327458    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327462    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327465    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327468    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327470    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327473    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327476    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327479    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327482    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327484    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327486    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327489    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327492    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327494    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327497    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.338602 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327499    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327502    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327504    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327507    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.327509    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.328186    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.338939    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.338953    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.338972    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.338980    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339040    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339046    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339049    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339052    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339055    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.339099 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339058    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339061    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339063    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339066    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339069    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339072    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339074    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339077    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339080    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339082    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339085    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339088    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339090    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339093    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339095    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339120    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339125    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339128    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339131    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.339497 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339133    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339136    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339138    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339141    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339144    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339146    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339149    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339151    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339154    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339156    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339159    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339161    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339164    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339166    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339169    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339172    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339175    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339180    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339183    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339186    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.339957 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339188    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339191    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339200    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339204    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339208    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339210    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339213    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339215    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339218    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339221    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339223    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339226    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339228    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339231    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339233    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339236    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339238    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339241    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339243    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339246    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.340472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339248    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339251    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339253    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339256    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339258    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339261    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339264    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339267    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339270    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339272    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339275    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339277    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339280    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339282    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339285    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339293    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339296    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339298    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339301    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339303    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.340954 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339306    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339308    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339311    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339313    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339316    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339318    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339321    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339323    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339327    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339330    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339333    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339336    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339339    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339342    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.341493 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339344    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.339349    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339475    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339480    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339483    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339487    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339490    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339493    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339496    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339498    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339501    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339504    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339507    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339509    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 17:14:28.341836 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339518    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339521    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339524    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339526    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339529    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339531    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339534    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339536    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339539    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339541    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339544    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339546    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339549    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339552    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339555    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339557    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339560    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339562    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339565    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339567    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 17:14:28.342295 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339569    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339573    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339577    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339579    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339583    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339585    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339588    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339590    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339593    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339595    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339598    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339600    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339603    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339613    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339616    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339619    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339622    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339624    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339627    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 17:14:28.342869 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339630    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339632    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339635    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339638    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339641    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339643    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339646    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339648    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339652    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339655    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339658    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339661    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339664    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339667    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339669    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339672    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339675    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339678    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339681    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 17:14:28.343486 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339683    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339685    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339688    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339690    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339693    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339695    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339698    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339700    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339710    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339712    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339715    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339717    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339720    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339722    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339725    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339727    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339730    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339732    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339734    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339737    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 17:14:28.344307 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339739    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339742    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339744    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339747    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339749    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339752    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339754    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339757    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:28.339759    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.339764    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.339877    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.342188    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.343084    2584 server.go:1019] "Starting client certificate rotation"
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.343217    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 17:14:28.344840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.343270    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 17:14:28.345694 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.345680    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 17:14:28.349360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.349344    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 17:14:28.360202 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.360183    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 18 17:14:28.362230 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.362212    2584 log.go:25] "Validated CRI v1 image API"
Sep 18 17:14:28.363155 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.363139    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 17:14:28.366575 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.366547    2584 fs.go:135] Filesystem UUIDs: map[59e2eda9-a977-4b87-b27f-3bfd8bd54fa0:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a590fd29-723e-47fa-9c2a-7df0855fd9fa:/dev/nvme0n1p3]
Sep 18 17:14:28.366652 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.366576    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 17:14:28.371862 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.371752    2584 manager.go:216] Machine: {Timestamp:2026-09-18 17:14:28.371211009 +0000 UTC m=+0.313468609 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3081206 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c30f35f45459f2aae87830c83a595 SystemUUID:ec2c30f3-5f45-459f-2aae-87830c83a595 BootID:46664d2e-5b7a-4233-9917-48d851af7110 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d2:ca:ac:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d2:ca:ac:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:fe:24:18:1c:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 17:14:28.371862 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.371850    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 17:14:28.372024 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.371944    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 17:14:28.375473 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.375421    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 17:14:28.375873 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.375524    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 17:14:28.376732 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.376717    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 17:14:28.377142 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.377128    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 17:14:28.377185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.377147    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 17:14:28.377185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.377154    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 17:14:28.377818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.377809    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 17:14:28.379387 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.379377    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 17:14:28.383676 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383664    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 17:14:28.383788 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383779    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 17:14:28.383824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383809    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 17:14:28.383824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383818    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 17:14:28.383878 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383828    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 17:14:28.383878 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383836    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 18 17:14:28.383878 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.383844    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 17:14:28.384186 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.384174    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 17:14:28.384231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.384195    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 17:14:28.387875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.387859    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 17:14:28.390729 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.390716    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 17:14:28.390788 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.390746    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 17:14:28.392298 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392286    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392302    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392308    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392314    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392322    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392327    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392341    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 17:14:28.392353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392346    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 17:14:28.392540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392368    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 17:14:28.392540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392374    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 17:14:28.392540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392382    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 17:14:28.392540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.392387    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 17:14:28.393097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.393089    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 17:14:28.393144 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.393098    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 17:14:28.395585 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.395561    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 17:14:28.395631 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.395571    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 17:14:28.395631 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.395566    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 17:14:28.397173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.397160    2584 server.go:1268] "Started kubelet"
Sep 18 17:14:28.397270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.397246    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 17:14:28.397400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.397295    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 17:14:28.397531 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.397518    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 17:14:28.397915 ip-10-0-135-187 systemd[1]: Started Kubernetes Kubelet.
Sep 18 17:14:28.398876 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.398843    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 17:14:28.399873 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.399860    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 17:14:28.402978 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.402951    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 17:14:28.404856 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.403970    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-187.ec2.internal.18d679a8eef8bfe8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-187.ec2.internal,UID:ip-10-0-135-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-187.ec2.internal,},FirstTimestamp:2026-09-18 17:14:28.397096936 +0000 UTC m=+0.339354536,LastTimestamp:2026-09-18 17:14:28.397096936 +0000 UTC m=+0.339354536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-187.ec2.internal,}"
Sep 18 17:14:28.409898 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.409884    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 17:14:28.410642 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.410513    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 17:14:28.410886 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.410871    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.411414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.411393    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 17:14:28.411481 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.411418    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 17:14:28.411481 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.411433    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 17:14:28.411584 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.411542    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 17:14:28.411584 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.411552    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 17:14:28.412678 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.412658    2584 factory.go:55] Registering systemd factory
Sep 18 17:14:28.412678 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.412682    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 18 17:14:28.412808 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.412745    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 17:14:28.412808 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.412749    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 17:14:28.412970 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.412952    2584 factory.go:153] Registering CRI-O factory
Sep 18 17:14:28.412970 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.412970    2584 factory.go:223] Registration of the crio container factory successfully
Sep 18 17:14:28.413138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.413018    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 17:14:28.413138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.413035    2584 factory.go:103] Registering Raw factory
Sep 18 17:14:28.413138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.413050    2584 manager.go:1196] Started watching for new ooms in manager
Sep 18 17:14:28.413518 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.413506    2584 manager.go:349] Starting recovery of all containers
Sep 18 17:14:28.425340 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.425324    2584 manager.go:354] Recovery completed
Sep 18 17:14:28.426371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.426349    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whp4l"
Sep 18 17:14:28.429242 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.429226    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.430998 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.430982    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.431059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431008    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.431059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431018    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.431960 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431947    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 17:14:28.431960 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431957    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 17:14:28.431960 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431959    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.432172 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.431971    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 17:14:28.432576 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.432560    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.432660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.432587    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.432660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.432601    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.434062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.434043    2584 policy_none.go:49] "None policy: Start"
Sep 18 17:14:28.434062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.434060    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 17:14:28.434222 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.434069    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 17:14:28.435092 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.435073    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-whp4l"
Sep 18 17:14:28.436653 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.436640    2584 policy_none.go:47] "Start"
Sep 18 17:14:28.441301 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.441219    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-187.ec2.internal.18d679a8f0fe03d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-187.ec2.internal,UID:ip-10-0-135-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-187.ec2.internal,},FirstTimestamp:2026-09-18 17:14:28.430996437 +0000 UTC m=+0.373254036,LastTimestamp:2026-09-18 17:14:28.430996437 +0000 UTC m=+0.373254036,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-187.ec2.internal,}"
Sep 18 17:14:28.466683 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.466671    2584 manager.go:337] "Starting Device Plugin manager"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.466702    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.466711    2584 server.go:87] "Starting device plugin registration server"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.466936    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.466949    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.467045    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.467675    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.467686    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.467690    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 17:14:28.487394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.467752    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.548405 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.548375    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 17:14:28.549801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.549781    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 17:14:28.549886 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.549842    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 17:14:28.549886 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.549868    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 17:14:28.549966 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.549906    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 17:14:28.552362 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.552345    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:28.567097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.567052    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.567846 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.567832    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.567895 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.567860    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.567895 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.567871    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.567895 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.567892    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.575027 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.575011    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.575080 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.575033    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-187.ec2.internal\": node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.602458 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.602443    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.650507 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.650487    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"]
Sep 18 17:14:28.650590 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.650554    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.652020 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.652005    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.652119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.652036    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.652119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.652045    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.654347 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.654334    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.654479 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.654455    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.654539 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.654498    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.655031 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655015    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.655120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655038    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.655120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655062    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.655120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655074    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.655120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655046    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.655246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.655142    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.657355 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.657338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.657441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.657361    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:28.657977 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.657961    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:28.658037 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.657991    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:28.658037 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.658007    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:28.673642 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.673620    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-187.ec2.internal\" not found" node="ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.677400 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.677386    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-187.ec2.internal\" not found" node="ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.702703 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.702674    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.712957 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.712939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/517bf25c721df95130fe87564d9fa154-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"517bf25c721df95130fe87564d9fa154\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.713305 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.713267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.713389 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.713330    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.803371 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.803352    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.813726 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813697    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/517bf25c721df95130fe87564d9fa154-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"517bf25c721df95130fe87564d9fa154\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.813820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813736    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.813820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.813820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.813820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf568e3aba8e93a8e14695934f21dfe8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal\" (UID: \"cf568e3aba8e93a8e14695934f21dfe8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.813957 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.813806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/517bf25c721df95130fe87564d9fa154-config\") pod \"kube-apiserver-proxy-ip-10-0-135-187.ec2.internal\" (UID: \"517bf25c721df95130fe87564d9fa154\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.904122 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:28.904073    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:28.978650 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.978613    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:28.982842 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:28.982824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:29.005215 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.005086    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.105723 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.105694    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.206227 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.206161    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.237168 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.237146    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:29.307169 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.307146    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.342665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.342641    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 17:14:29.343049 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.342775    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 17:14:29.343049 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.342806    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 17:14:29.407322 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.407293    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.440461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.440430    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 17:09:29 +0000 UTC" deadline="2028-04-22 14:43:33.712322832 +0000 UTC"
Sep 18 17:14:29.440461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.440459    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13965h29m4.271866593s"
Sep 18 17:14:29.489859 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.489838    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 17:14:29.490977 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.490958    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 17:14:29.491032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.491000    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 17:14:29.491032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.491014    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeHasSufficientPID"
Sep 18 17:14:29.508296 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.508276    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.608872 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:29.608831    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-187.ec2.internal\" not found"
Sep 18 17:14:29.640867 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:29.640820    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod517bf25c721df95130fe87564d9fa154.slice/crio-904e2e3684eb0e434255e5df5da57da8398cc242b766e3b9ec2432ebf014cfd3 WatchSource:0}: Error finding container 904e2e3684eb0e434255e5df5da57da8398cc242b766e3b9ec2432ebf014cfd3: Status 404 returned error can't find the container with id 904e2e3684eb0e434255e5df5da57da8398cc242b766e3b9ec2432ebf014cfd3
Sep 18 17:14:29.641397 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:29.641372    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf568e3aba8e93a8e14695934f21dfe8.slice/crio-39c6ce908d8b03c81d8dc9ff728815393d2c44c9d1e9aafeb060dbf460cc7ba4 WatchSource:0}: Error finding container 39c6ce908d8b03c81d8dc9ff728815393d2c44c9d1e9aafeb060dbf460cc7ba4: Status 404 returned error can't find the container with id 39c6ce908d8b03c81d8dc9ff728815393d2c44c9d1e9aafeb060dbf460cc7ba4
Sep 18 17:14:29.647456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.647437    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:14:29.666736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.666712    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:29.681470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.681445    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:29.710862 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.710845    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:29.725488 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.725443    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 17:14:29.726461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.726446    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal"
Sep 18 17:14:29.735817 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:29.735798    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 17:14:30.385471 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.385440    2584 apiserver.go:52] "Watching apiserver"
Sep 18 17:14:30.394067 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.394042    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 17:14:30.394587 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.394557    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-cqpwz","openshift-network-operator/iptables-alerter-nnvdc","openshift-ovn-kubernetes/ovnkube-node-f9mxp","kube-system/global-pull-secret-syncer-7f5hp","kube-system/konnectivity-agent-w4ph9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9","openshift-cluster-node-tuning-operator/tuned-bpbls","openshift-dns/node-resolver-pd2vh","openshift-image-registry/node-ca-2f7l9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal","openshift-network-diagnostics/network-check-target-hzv2v","kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal","openshift-multus/multus-4zg8j","openshift-multus/multus-additional-cni-plugins-pxb62"]
Sep 18 17:14:30.397308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.397280    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.399254 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.399231    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.400227 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.400144    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.400794 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.400629    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4ft2\""
Sep 18 17:14:30.400794 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.400658    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.402792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.401838    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 17:14:30.402792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.402253    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 17:14:30.402792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.402530    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.402792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.402704    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.402792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.402730    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lxbz\""
Sep 18 17:14:30.403092 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.403027    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.403984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.403966    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.404074 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.404048    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:30.406677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.406098    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.409121    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.409423    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.409724    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m626r\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.409785    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.409730    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.410031    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.410367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.410310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.411769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.410883    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 17:14:30.412289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.412269    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.413342 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.413321    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 17:14:30.413342 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.413337    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c4zw5\""
Sep 18 17:14:30.413622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.413388    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 17:14:30.415244 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.415222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 17:14:30.415714 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.415254    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.415850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.415818    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.415948 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.415924    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z25s6\""
Sep 18 17:14:30.416116 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.416069    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.418491 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.418470    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.418895 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.418876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5rn2p\""
Sep 18 17:14:30.419017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.418878    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.419101 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.419023    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 17:14:30.419796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.419779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.419884 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.419853    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:30.422006 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.421985    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.423678 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-tmp\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.423791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.423791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-script-lib\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.423791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423748    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-systemd\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.423791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423773    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-multus-certs\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-ovn\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423821    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-kubelet-config\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423851    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-etc-selinux\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-sys-fs\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-k8s-cni-cncf-io\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-hostroot\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-cnibin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.423991    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-bin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-etc-kubernetes\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424058    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntbp\" (UniqueName: \"kubernetes.io/projected/471185b4-d1b3-4aea-ac64-4d422fd331eb-kube-api-access-kntbp\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424110    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-config\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-env-overrides\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e49a0b-5a57-42df-8083-78563bf3056f-konnectivity-ca\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-modprobe-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-conf\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-run\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-socket-dir-parent\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-kubelet\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-registration-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424326    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-kubelet\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424362    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-netns\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.424395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e49a0b-5a57-42df-8083-78563bf3056f-agent-certs\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kdm5\" (UniqueName: \"kubernetes.io/projected/817a7a86-d1df-463d-bcf3-9168d7a92ce4-kube-api-access-6kdm5\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424481    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424485    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-cni-binary-copy\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-log-socket\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424546    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-device-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424609    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wzh\" (UniqueName: \"kubernetes.io/projected/a9d8b636-7912-400e-9d91-217d06d5fe41-kube-api-access-55wzh\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-kubernetes\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424661    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-dbus\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424696    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-node-log\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-bin\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424747    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424766    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovn-node-metrics-cert\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-socket-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.425262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-host\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkrmv\" (UniqueName: \"kubernetes.io/projected/f4b5fc06-218e-4769-a9f6-2b5e38768741-kube-api-access-bkrmv\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-var-lib-kubelet\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-systemd-units\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424967    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.424994    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-sys\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-conf-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-slash\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425067    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-lib-modules\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-system-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425199    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-var-lib-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425251    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-etc-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425279    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-netd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysconfig\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425336    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-tuned\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425379    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-netns\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425416    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-multus\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.426119 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425443    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-daemon-config\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.426883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-systemd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.426883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.425878    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.426883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.426307    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sqknz\""
Sep 18 17:14:30.428442 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.428394    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 17:14:30.428618 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.428597    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:30.428793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.428614    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-54h9t\""
Sep 18 17:14:30.428793 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.428745    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:30.429029 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.428997    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 17:14:30.431312 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.431092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.433682 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.433659    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 17:14:30.434072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.434024    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 17:14:30.434259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.434240    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ptg44\""
Sep 18 17:14:30.450666 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.450631    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5mdb"
Sep 18 17:14:30.459494 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.459471    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-w5mdb"
Sep 18 17:14:30.513025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.512944    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 17:14:30.526844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-var-lib-kubelet\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526856    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-systemd-units\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526969    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-serviceca\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.526982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-var-lib-kubelet\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.526993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-sys\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-conf-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-slash\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527102    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-lib-modules\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-system-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.527148    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-var-lib-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.527231    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:31.027197688 +0000 UTC m=+2.969455294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527248    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-var-lib-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527252    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-etc-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527031    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-systemd-units\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-netd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527330    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-conf-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-sys\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-slash\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-system-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-lib-modules\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-etc-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527569    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cnibin\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-netd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysconfig\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527612    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-tuned\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-netns\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-multus\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysconfig\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.527993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.527876    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528082    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-daemon-config\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528168    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-multus\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-systemd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-netns\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528237    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-systemd\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528300    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528355    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-tmp\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-script-lib\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htlkl\" (UniqueName: \"kubernetes.io/projected/c9f18120-ba2e-4f22-a3c1-c9e5314309af-kube-api-access-htlkl\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66l4\" (UniqueName: \"kubernetes.io/projected/305ddf7d-642c-413e-91e4-64d8a6c1b972-kube-api-access-b66l4\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.528705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-systemd\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-multus-certs\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-ovn\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528901    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-daemon-config\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528911    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-kubelet-config\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-etc-selinux\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-sys-fs\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-systemd\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.528992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-k8s-cni-cncf-io\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-hostroot\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-k8s-cni-cncf-io\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529070    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-host\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529089    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-run-multus-certs\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529095    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-cnibin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529135    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-bin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529159    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-etc-kubernetes\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntbp\" (UniqueName: \"kubernetes.io/projected/471185b4-d1b3-4aea-ac64-4d422fd331eb-kube-api-access-kntbp\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-etc-selinux\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.529421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-config\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-sys-fs\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529391    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-kubelet-config\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529433    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-openvswitch\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-run-ovn\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-cni-bin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c764ea-a972-4f46-9ff9-8a0057e361b4-iptables-alerter-script\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-system-cni-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-env-overrides\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-etc-kubernetes\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529557    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-cnibin\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529602    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e49a0b-5a57-42df-8083-78563bf3056f-konnectivity-ca\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c764ea-a972-4f46-9ff9-8a0057e361b4-host-slash\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-modprobe-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.530372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-conf\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-run\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-script-lib\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529783    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-socket-dir-parent\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529731    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-hostroot\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-kubelet\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529880    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-registration-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-modprobe-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529907    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617eb0a-3bb5-40c9-90e4-b246d680118e-tmp-dir\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xfr\" (UniqueName: \"kubernetes.io/projected/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-kube-api-access-84xfr\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-conf\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.529969    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-run\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530005    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-registration-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530034    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-host-var-lib-kubelet\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530043    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-kubelet\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-kubelet\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-netns\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e49a0b-5a57-42df-8083-78563bf3056f-agent-certs\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.531226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0e49a0b-5a57-42df-8083-78563bf3056f-konnectivity-ca\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530273    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-run-netns\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdq4s\" (UniqueName: \"kubernetes.io/projected/d617eb0a-3bb5-40c9-90e4-b246d680118e-kube-api-access-sdq4s\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530335    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-socket-dir-parent\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-env-overrides\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530370    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kdm5\" (UniqueName: \"kubernetes.io/projected/817a7a86-d1df-463d-bcf3-9168d7a92ce4-kube-api-access-6kdm5\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530395    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-cni-binary-copy\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-log-socket\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-sysctl-d\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-device-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovnkube-config\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530538    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wzh\" (UniqueName: \"kubernetes.io/projected/a9d8b636-7912-400e-9d91-217d06d5fe41-kube-api-access-55wzh\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617eb0a-3bb5-40c9-90e4-b246d680118e-hosts-file\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.532121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530677    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-kubernetes\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-dbus\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-node-log\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-bin\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovn-node-metrics-cert\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530844    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/471185b4-d1b3-4aea-ac64-4d422fd331eb-cni-binary-copy\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-socket-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-host\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-log-socket\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkrmv\" (UniqueName: \"kubernetes.io/projected/f4b5fc06-218e-4769-a9f6-2b5e38768741-kube-api-access-bkrmv\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-dbus\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.530980    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hndmt\" (UniqueName: \"kubernetes.io/projected/a7c764ea-a972-4f46-9ff9-8a0057e361b4-kube-api-access-hndmt\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-kubernetes\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-host-cni-bin\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/471185b4-d1b3-4aea-ac64-4d422fd331eb-multus-cni-dir\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/817a7a86-d1df-463d-bcf3-9168d7a92ce4-host\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.532992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531221    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-device-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.533791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531286    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f4b5fc06-218e-4769-a9f6-2b5e38768741-node-log\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.533791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.531379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9d8b636-7912-400e-9d91-217d06d5fe41-socket-dir\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.533791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.532351    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-etc-tuned\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.533791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.532344    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/817a7a86-d1df-463d-bcf3-9168d7a92ce4-tmp\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.534816 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.534791    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4b5fc06-218e-4769-a9f6-2b5e38768741-ovn-node-metrics-cert\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.540802 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.540778    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntbp\" (UniqueName: \"kubernetes.io/projected/471185b4-d1b3-4aea-ac64-4d422fd331eb-kube-api-access-kntbp\") pod \"multus-4zg8j\" (UID: \"471185b4-d1b3-4aea-ac64-4d422fd331eb\") " pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.541834 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.541231    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0e49a0b-5a57-42df-8083-78563bf3056f-agent-certs\") pod \"konnectivity-agent-w4ph9\" (UID: \"c0e49a0b-5a57-42df-8083-78563bf3056f\") " pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.542665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.542641    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkrmv\" (UniqueName: \"kubernetes.io/projected/f4b5fc06-218e-4769-a9f6-2b5e38768741-kube-api-access-bkrmv\") pod \"ovnkube-node-f9mxp\" (UID: \"f4b5fc06-218e-4769-a9f6-2b5e38768741\") " pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.544306 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.544253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wzh\" (UniqueName: \"kubernetes.io/projected/a9d8b636-7912-400e-9d91-217d06d5fe41-kube-api-access-55wzh\") pod \"aws-ebs-csi-driver-node-knsv9\" (UID: \"a9d8b636-7912-400e-9d91-217d06d5fe41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.545247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.545225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kdm5\" (UniqueName: \"kubernetes.io/projected/817a7a86-d1df-463d-bcf3-9168d7a92ce4-kube-api-access-6kdm5\") pod \"tuned-bpbls\" (UID: \"817a7a86-d1df-463d-bcf3-9168d7a92ce4\") " pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.557220 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.557148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"cf568e3aba8e93a8e14695934f21dfe8","Type":"ContainerStarted","Data":"39c6ce908d8b03c81d8dc9ff728815393d2c44c9d1e9aafeb060dbf460cc7ba4"}
Sep 18 17:14:30.560063 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.560039    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" event={"ID":"517bf25c721df95130fe87564d9fa154","Type":"ContainerStarted","Data":"904e2e3684eb0e434255e5df5da57da8398cc242b766e3b9ec2432ebf014cfd3"}
Sep 18 17:14:30.631628 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hndmt\" (UniqueName: \"kubernetes.io/projected/a7c764ea-a972-4f46-9ff9-8a0057e361b4-kube-api-access-hndmt\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631653    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631679    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631700    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-serviceca\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cnibin\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.631801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htlkl\" (UniqueName: \"kubernetes.io/projected/c9f18120-ba2e-4f22-a3c1-c9e5314309af-kube-api-access-htlkl\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66l4\" (UniqueName: \"kubernetes.io/projected/305ddf7d-642c-413e-91e4-64d8a6c1b972-kube-api-access-b66l4\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-host\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c764ea-a972-4f46-9ff9-8a0057e361b4-iptables-alerter-script\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631893    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-system-cni-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c764ea-a972-4f46-9ff9-8a0057e361b4-host-slash\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.631974    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617eb0a-3bb5-40c9-90e4-b246d680118e-tmp-dir\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xfr\" (UniqueName: \"kubernetes.io/projected/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-kube-api-access-84xfr\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdq4s\" (UniqueName: \"kubernetes.io/projected/d617eb0a-3bb5-40c9-90e4-b246d680118e-kube-api-access-sdq4s\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632060    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632110 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617eb0a-3bb5-40c9-90e4-b246d680118e-hosts-file\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617eb0a-3bb5-40c9-90e4-b246d680118e-hosts-file\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-binary-copy\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632393    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-system-cni-dir\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.632710 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632663    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cnibin\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.633018 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-serviceca\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.633018 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.632906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a7c764ea-a972-4f46-9ff9-8a0057e361b4-host-slash\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.633018 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.632991    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:30.633194 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.633044    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:31.133026649 +0000 UTC m=+3.075284238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:30.633194 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.633154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.633326 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.633231    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-host\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.633326 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.633247    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a7c764ea-a972-4f46-9ff9-8a0057e361b4-iptables-alerter-script\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.633555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.633497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617eb0a-3bb5-40c9-90e4-b246d680118e-tmp-dir\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.633696 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.633676    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c9f18120-ba2e-4f22-a3c1-c9e5314309af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.641218 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.641118    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:30.641218 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.641170    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:30.641218 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.641183    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:30.641435 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:30.641254    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:14:31.141235881 +0000 UTC m=+3.083493490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:30.643575 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.643498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdq4s\" (UniqueName: \"kubernetes.io/projected/d617eb0a-3bb5-40c9-90e4-b246d680118e-kube-api-access-sdq4s\") pod \"node-resolver-pd2vh\" (UID: \"d617eb0a-3bb5-40c9-90e4-b246d680118e\") " pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.643575 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.643540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66l4\" (UniqueName: \"kubernetes.io/projected/305ddf7d-642c-413e-91e4-64d8a6c1b972-kube-api-access-b66l4\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:30.644017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.643928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xfr\" (UniqueName: \"kubernetes.io/projected/93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55-kube-api-access-84xfr\") pod \"node-ca-2f7l9\" (UID: \"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55\") " pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.644327 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.644291    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndmt\" (UniqueName: \"kubernetes.io/projected/a7c764ea-a972-4f46-9ff9-8a0057e361b4-kube-api-access-hndmt\") pod \"iptables-alerter-nnvdc\" (UID: \"a7c764ea-a972-4f46-9ff9-8a0057e361b4\") " pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.645007 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.644977    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htlkl\" (UniqueName: \"kubernetes.io/projected/c9f18120-ba2e-4f22-a3c1-c9e5314309af-kube-api-access-htlkl\") pod \"multus-additional-cni-plugins-pxb62\" (UID: \"c9f18120-ba2e-4f22-a3c1-c9e5314309af\") " pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.713556 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.713520    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bpbls"
Sep 18 17:14:30.725440 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.725419    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4zg8j"
Sep 18 17:14:30.725550 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.725501    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817a7a86_d1df_463d_bcf3_9168d7a92ce4.slice/crio-453c2bd472f26faeae791840cf6c36b293f7be980bc1f425a4676c7788885c0b WatchSource:0}: Error finding container 453c2bd472f26faeae791840cf6c36b293f7be980bc1f425a4676c7788885c0b: Status 404 returned error can't find the container with id 453c2bd472f26faeae791840cf6c36b293f7be980bc1f425a4676c7788885c0b
Sep 18 17:14:30.735523 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.735497    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471185b4_d1b3_4aea_ac64_4d422fd331eb.slice/crio-8370baca8a526b6f1156600ceadf71f4c15e76bf0205f057f93ac44acd022527 WatchSource:0}: Error finding container 8370baca8a526b6f1156600ceadf71f4c15e76bf0205f057f93ac44acd022527: Status 404 returned error can't find the container with id 8370baca8a526b6f1156600ceadf71f4c15e76bf0205f057f93ac44acd022527
Sep 18 17:14:30.737561 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.737333    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:30.745998 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.745977    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:30.747536 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.747508    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b5fc06_218e_4769_a9f6_2b5e38768741.slice/crio-4768bedbe7ab38882cd7a1a01431ac949cf419dab064b9d4acbd5293f6ca44b8 WatchSource:0}: Error finding container 4768bedbe7ab38882cd7a1a01431ac949cf419dab064b9d4acbd5293f6ca44b8: Status 404 returned error can't find the container with id 4768bedbe7ab38882cd7a1a01431ac949cf419dab064b9d4acbd5293f6ca44b8
Sep 18 17:14:30.755695 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.755673    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9"
Sep 18 17:14:30.756886 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.756860    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e49a0b_5a57_42df_8083_78563bf3056f.slice/crio-6f825bf9de98c7ee2fba05bee2eda28343609c78826195cff58e317aa6b6602c WatchSource:0}: Error finding container 6f825bf9de98c7ee2fba05bee2eda28343609c78826195cff58e317aa6b6602c: Status 404 returned error can't find the container with id 6f825bf9de98c7ee2fba05bee2eda28343609c78826195cff58e317aa6b6602c
Sep 18 17:14:30.766562 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.766539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2f7l9"
Sep 18 17:14:30.768406 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.768383    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d8b636_7912_400e_9d91_217d06d5fe41.slice/crio-7159ddfc6d1bb26231f9d930a23acbd6e167dc86fc3eca108bc210b3000630af WatchSource:0}: Error finding container 7159ddfc6d1bb26231f9d930a23acbd6e167dc86fc3eca108bc210b3000630af: Status 404 returned error can't find the container with id 7159ddfc6d1bb26231f9d930a23acbd6e167dc86fc3eca108bc210b3000630af
Sep 18 17:14:30.775885 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.775865    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nnvdc"
Sep 18 17:14:30.784939 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.784908    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cd3e32_f0f3_44f3_9cfd_4bb6e687cb55.slice/crio-735ef70a806d7e8e325b2748ca797da47026502b493c979bd64c11d1e3c36a2a WatchSource:0}: Error finding container 735ef70a806d7e8e325b2748ca797da47026502b493c979bd64c11d1e3c36a2a: Status 404 returned error can't find the container with id 735ef70a806d7e8e325b2748ca797da47026502b493c979bd64c11d1e3c36a2a
Sep 18 17:14:30.785177 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.784983    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pxb62"
Sep 18 17:14:30.786530 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.786416    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c764ea_a972_4f46_9ff9_8a0057e361b4.slice/crio-0a97d8f98b5889bd68993903b8d539ed518748d5a4aec6f0df86e09a1bc9c1cb WatchSource:0}: Error finding container 0a97d8f98b5889bd68993903b8d539ed518748d5a4aec6f0df86e09a1bc9c1cb: Status 404 returned error can't find the container with id 0a97d8f98b5889bd68993903b8d539ed518748d5a4aec6f0df86e09a1bc9c1cb
Sep 18 17:14:30.792519 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.792490    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pd2vh"
Sep 18 17:14:30.795766 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.795738    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9f18120_ba2e_4f22_a3c1_c9e5314309af.slice/crio-abfdd585b6dd2227ab9975aa6f3894a47218b1dd0d87c080d449e9b45ab9859b WatchSource:0}: Error finding container abfdd585b6dd2227ab9975aa6f3894a47218b1dd0d87c080d449e9b45ab9859b: Status 404 returned error can't find the container with id abfdd585b6dd2227ab9975aa6f3894a47218b1dd0d87c080d449e9b45ab9859b
Sep 18 17:14:30.803814 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:14:30.803790    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd617eb0a_3bb5_40c9_90e4_b246d680118e.slice/crio-5d28673da64feb5d7833996f9a7243a6e389c172f29f2e380edb48383237d0e8 WatchSource:0}: Error finding container 5d28673da64feb5d7833996f9a7243a6e389c172f29f2e380edb48383237d0e8: Status 404 returned error can't find the container with id 5d28673da64feb5d7833996f9a7243a6e389c172f29f2e380edb48383237d0e8
Sep 18 17:14:30.896341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:30.896264    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:31.034009 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.033970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:31.034229 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.034166    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:31.034316 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.034234    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:32.034216639 +0000 UTC m=+3.976474252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:31.134504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.134464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:31.134668 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.134650    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:31.134745 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.134734    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:32.13471405 +0000 UTC m=+4.076971656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:31.235593 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.235503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:31.235743 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.235706    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:31.235743 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.235738    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:31.235841 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.235753    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:31.235841 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.235827    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:14:32.235804626 +0000 UTC m=+4.178062232 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:31.463651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.463541    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 17:09:31 +0000 UTC" deadline="2028-06-15 15:28:22.715684136 +0000 UTC"
Sep 18 17:14:31.463651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.463647    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15262h13m51.252040868s"
Sep 18 17:14:31.552911 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.552825    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:31.553075 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.552938    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:31.553494 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.553475    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:31.553595 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:31.553550    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:31.564488 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.564448    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9" event={"ID":"a9d8b636-7912-400e-9d91-217d06d5fe41","Type":"ContainerStarted","Data":"7159ddfc6d1bb26231f9d930a23acbd6e167dc86fc3eca108bc210b3000630af"}
Sep 18 17:14:31.567086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.567045    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4ph9" event={"ID":"c0e49a0b-5a57-42df-8083-78563bf3056f","Type":"ContainerStarted","Data":"6f825bf9de98c7ee2fba05bee2eda28343609c78826195cff58e317aa6b6602c"}
Sep 18 17:14:31.568707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.568678    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"4768bedbe7ab38882cd7a1a01431ac949cf419dab064b9d4acbd5293f6ca44b8"}
Sep 18 17:14:31.571818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.571778    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zg8j" event={"ID":"471185b4-d1b3-4aea-ac64-4d422fd331eb","Type":"ContainerStarted","Data":"8370baca8a526b6f1156600ceadf71f4c15e76bf0205f057f93ac44acd022527"}
Sep 18 17:14:31.573497 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.573439    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerStarted","Data":"abfdd585b6dd2227ab9975aa6f3894a47218b1dd0d87c080d449e9b45ab9859b"}
Sep 18 17:14:31.575129 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.575099    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bpbls" event={"ID":"817a7a86-d1df-463d-bcf3-9168d7a92ce4","Type":"ContainerStarted","Data":"453c2bd472f26faeae791840cf6c36b293f7be980bc1f425a4676c7788885c0b"}
Sep 18 17:14:31.576435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.576402    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd2vh" event={"ID":"d617eb0a-3bb5-40c9-90e4-b246d680118e","Type":"ContainerStarted","Data":"5d28673da64feb5d7833996f9a7243a6e389c172f29f2e380edb48383237d0e8"}
Sep 18 17:14:31.577858 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.577832    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnvdc" event={"ID":"a7c764ea-a972-4f46-9ff9-8a0057e361b4","Type":"ContainerStarted","Data":"0a97d8f98b5889bd68993903b8d539ed518748d5a4aec6f0df86e09a1bc9c1cb"}
Sep 18 17:14:31.579235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:31.579206    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2f7l9" event={"ID":"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55","Type":"ContainerStarted","Data":"735ef70a806d7e8e325b2748ca797da47026502b493c979bd64c11d1e3c36a2a"}
Sep 18 17:14:32.042948 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.042899    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:32.043169 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.043095    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:32.043239 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.043181    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:34.043141751 +0000 UTC m=+5.985399343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:32.144470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.144430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:32.144654 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.144614    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:32.144724 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.144683    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:34.144662995 +0000 UTC m=+6.086920591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:32.245774 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.245664    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:32.245939 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.245914    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:32.245939 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.245937    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:32.246061 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.245952    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:32.246061 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.246014    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:14:34.245994272 +0000 UTC m=+6.188251886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:32.269409 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.269375    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 17:14:32.464807 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.464759    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 17:09:31 +0000 UTC" deadline="2028-04-15 09:30:58.720043717 +0000 UTC"
Sep 18 17:14:32.464807 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.464808    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13792h16m26.255243242s"
Sep 18 17:14:32.554079 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:32.551196    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:32.554079 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:32.551339    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:33.551602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:33.550888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:33.551602 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:33.551038    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:33.551602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:33.551441    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:33.551602 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:33.551548    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:34.061615 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:34.061568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:34.061806 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.061770    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:34.061902 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.061838    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:38.061819261 +0000 UTC m=+10.004076855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:34.163197 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:34.163143    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:34.163394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.163301    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:34.163394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.163371    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:38.163350289 +0000 UTC m=+10.105607883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:34.264629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:34.264585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:34.264815 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.264778    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:34.264815 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.264799    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:34.264815 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.264813    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:34.264991 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.264881    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:14:38.26486224 +0000 UTC m=+10.207119835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:34.555074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:34.554571    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:34.555074 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:34.554695    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:35.550540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:35.550504    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:35.550750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:35.550548    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:35.550750 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:35.550627    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:35.550890 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:35.550757    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:36.550684 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:36.550651    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:36.551178 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:36.550857    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:37.550683 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:37.550619    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:37.550958 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:37.550764    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:37.551398 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:37.551195    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:37.551398 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:37.551338    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:38.097239 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:38.097196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:38.097412 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.097343    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:38.097412 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.097408    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:46.097390096 +0000 UTC m=+18.039647691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:38.198224 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:38.198108    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:38.198430 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.198277    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:38.198430 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.198358    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:14:46.198337541 +0000 UTC m=+18.140595135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:38.298789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:38.298704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:38.298955 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.298866    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:38.298955 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.298882    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:38.298955 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.298891    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:38.299106 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.298973    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:14:46.298952846 +0000 UTC m=+18.241210450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:38.554625 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:38.554547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:38.555051 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:38.554655    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:39.551023 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:39.550988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:39.551206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:39.551041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:39.551206 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:39.551135    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:39.551327 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:39.551205    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:40.550949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:40.550467    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:40.550949 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:40.550636    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:41.551120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:41.551066    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:41.551120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:41.551097    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:41.551565 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:41.551229    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:41.551565 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:41.551344    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:42.553099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:42.553038    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:42.553483 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:42.553163    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:43.550712 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:43.550674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:43.550877 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:43.550805    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:43.550941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:43.550873    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:43.551044 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:43.551018    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:44.550727 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:44.550694    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:44.551199 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:44.550818    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:45.550958 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:45.550922    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:45.551497 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:45.550967    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:45.551497 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:45.551054    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:45.551497 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:45.551147    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:46.161394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:46.161360    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:46.161531 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.161513    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:46.161587 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.161576    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:02.16156127 +0000 UTC m=+34.103818856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:14:46.262576 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:46.262550    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:46.262713 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.262688    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:46.262757 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.262740    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:02.26272711 +0000 UTC m=+34.204984696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:14:46.363575 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:46.363531    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:46.363728 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.363691    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:14:46.363728 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.363715    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:14:46.363728 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.363726    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:46.363895 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.363789    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:15:02.363771329 +0000 UTC m=+34.306028917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:14:46.550969 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:46.550897    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:46.551362 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:46.551003    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:47.551054 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:47.551020    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:47.551499 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:47.551142    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:47.551499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:47.551204    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:47.551499 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:47.551323    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:48.551675 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:48.551640    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:48.552076 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:48.551743    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:49.550828 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:49.550797    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:49.551000 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:49.550897    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:49.551000 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:49.550932    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:49.551000 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:49.550980    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:50.553792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.552621    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:50.553792 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:50.553138    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:50.644999 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.644974    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:14:50.645431 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645408    2584 generic.go:356] "Generic (PLEG): container finished" podID="f4b5fc06-218e-4769-a9f6-2b5e38768741" containerID="f7bc4f421b5c6632c6cb8c7c73022e4b6fdf552c330a8557fc3a0b7714876458" exitCode=1
Sep 18 17:14:50.645535 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645477    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"b1b2895dcc88c230ee52f8595ad9bd638d22dfbc89b553f0fae77c781c3bd6fc"}
Sep 18 17:14:50.645598 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645559    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"2a1ee977c4bf8e6966a357033586ed3e7910928d380ec360ff0552dbb86253ef"}
Sep 18 17:14:50.645658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"8c9dad99cf15df2499dd967a239a1316e0138352a5ab71a1bae751ad83c54355"}
Sep 18 17:14:50.645707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645655    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerDied","Data":"f7bc4f421b5c6632c6cb8c7c73022e4b6fdf552c330a8557fc3a0b7714876458"}
Sep 18 17:14:50.645707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.645702    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"ae4730a57cef4755dd7be6bbc68087eb40a109c8a26d657cdac86623ec1cf5cd"}
Sep 18 17:14:50.649738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.649711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4zg8j" event={"ID":"471185b4-d1b3-4aea-ac64-4d422fd331eb","Type":"ContainerStarted","Data":"be0ffb694eae8b3fffe5ceb7d70dbbd2f3ae9e52e0e556edd48c344beb02c1ea"}
Sep 18 17:14:50.653780 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.653705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" event={"ID":"517bf25c721df95130fe87564d9fa154","Type":"ContainerStarted","Data":"58840799bb4cee48e42507ec41f1185483105a16fa4b6ca220d8713478a54d9a"}
Sep 18 17:14:50.657706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.657674    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bpbls" event={"ID":"817a7a86-d1df-463d-bcf3-9168d7a92ce4","Type":"ContainerStarted","Data":"a3f9a474fc8b9663b9d60a64e4aecaa16b0ebaa857f6ba6d10a3aaed0bc457a6"}
Sep 18 17:14:50.678528 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.678451    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4zg8j" podStartSLOduration=2.030170807 podStartE2EDuration="21.678431207s" totalImagesPullingTime="19.6482604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:50.677933084 +0000 UTC m=+22.620190690" watchObservedRunningTime="2026-09-18 17:14:50.678431207 +0000 UTC m=+22.620688816"
Sep 18 17:14:50.704122 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.703852    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bpbls" podStartSLOduration=2.362075854 podStartE2EDuration="21.703833928s" totalImagesPullingTime="19.341758074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:50.700850877 +0000 UTC m=+22.643108486" watchObservedRunningTime="2026-09-18 17:14:50.703833928 +0000 UTC m=+22.646091539"
Sep 18 17:14:50.721032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:50.720993    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-187.ec2.internal" podStartSLOduration=20.720979612 podStartE2EDuration="20.720979612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:50.720329422 +0000 UTC m=+22.662587030" watchObservedRunningTime="2026-09-18 17:14:50.720979612 +0000 UTC m=+22.663237222"
Sep 18 17:14:51.550291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.550263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:51.550291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.550284    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:51.550508 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:51.550361    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:51.550569 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:51.550538    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:51.660571 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.660507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4ph9" event={"ID":"c0e49a0b-5a57-42df-8083-78563bf3056f","Type":"ContainerStarted","Data":"dc161984b37d08b0cc3a775d9f0d0f1a3143e27b11be74d1aa42f726e83c5be4"}
Sep 18 17:14:51.663366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.663348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:14:51.663738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.663718    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"828e780d21b0ab36d15c32e253662ed0b9151f66dc7233281ff6a72c65b29d16"}
Sep 18 17:14:51.665100 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.665082    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="05723c35b5725f771fe56e656e4b5cc1ed8168f56c0144b09e923f2445ed3008" exitCode=0
Sep 18 17:14:51.665209 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.665135    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"05723c35b5725f771fe56e656e4b5cc1ed8168f56c0144b09e923f2445ed3008"}
Sep 18 17:14:51.666554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.666535    2584 generic.go:356] "Generic (PLEG): container finished" podID="cf568e3aba8e93a8e14695934f21dfe8" containerID="48c561a87cb8197f0dbe4338aa3d54331c2b4db7ba8f9b95715eca6e489f9342" exitCode=0
Sep 18 17:14:51.666620 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.666601    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"cf568e3aba8e93a8e14695934f21dfe8","Type":"ContainerDied","Data":"48c561a87cb8197f0dbe4338aa3d54331c2b4db7ba8f9b95715eca6e489f9342"}
Sep 18 17:14:51.668117 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.668083    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pd2vh" event={"ID":"d617eb0a-3bb5-40c9-90e4-b246d680118e","Type":"ContainerStarted","Data":"7753ebfe8629849b047fc84673b94e0d38d65bf2dd55ac1e268ecb18037e2f53"}
Sep 18 17:14:51.669460 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.669436    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nnvdc" event={"ID":"a7c764ea-a972-4f46-9ff9-8a0057e361b4","Type":"ContainerStarted","Data":"04c95d4641fde6cb57ba59a7e88662b8781277ebd56e642996ede95bda2f1b8f"}
Sep 18 17:14:51.671033 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.671011    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2f7l9" event={"ID":"93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55","Type":"ContainerStarted","Data":"c31a098d7bc871e0a8027fde466c59ebc2de28bdefd21a8007d2bda80dee968a"}
Sep 18 17:14:51.672592 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.672561    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9" event={"ID":"a9d8b636-7912-400e-9d91-217d06d5fe41","Type":"ContainerStarted","Data":"2615c9158ae23ce59197559fb74b446bed0ec87cd1686b27f4c73de611411262"}
Sep 18 17:14:51.693793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.693662    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nnvdc" podStartSLOduration=3.412712472 podStartE2EDuration="22.693646621s" totalImagesPullingTime="19.280934149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:51.693280832 +0000 UTC m=+23.635538442" watchObservedRunningTime="2026-09-18 17:14:51.693646621 +0000 UTC m=+23.635904231"
Sep 18 17:14:51.693967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.693939    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w4ph9" podStartSLOduration=7.257078104 podStartE2EDuration="22.693932653s" totalImagesPullingTime="15.436854549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:51.677379989 +0000 UTC m=+23.619637598" watchObservedRunningTime="2026-09-18 17:14:51.693932653 +0000 UTC m=+23.636190261"
Sep 18 17:14:51.731288 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.731248    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2f7l9" podStartSLOduration=3.449659834 podStartE2EDuration="22.73123587s" totalImagesPullingTime="19.281576036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:51.730760823 +0000 UTC m=+23.673018433" watchObservedRunningTime="2026-09-18 17:14:51.73123587 +0000 UTC m=+23.673493483"
Sep 18 17:14:51.753216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:51.753181    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pd2vh" podStartSLOduration=3.5520445819999997 podStartE2EDuration="22.753170267s" totalImagesPullingTime="19.201125685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:51.75299433 +0000 UTC m=+23.695251939" watchObservedRunningTime="2026-09-18 17:14:51.753170267 +0000 UTC m=+23.695427875"
Sep 18 17:14:52.058993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.058969    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 17:14:52.449598 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.449577    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:52.481818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.481724    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T17:14:52.058992626Z","UUID":"04fdd5f6-88da-48ff-9c49-cf2cdbb1ad30","Handler":null,"Name":"","Endpoint":""}
Sep 18 17:14:52.483370 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.483346    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 17:14:52.483474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.483380    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 17:14:52.550775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.550749    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:52.550889 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:52.550846    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:52.676385 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.676348    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" event={"ID":"cf568e3aba8e93a8e14695934f21dfe8","Type":"ContainerStarted","Data":"4ce0fffd9ff305e4277c189354abbbb2108d836a59cbde5ad22f7ba7c94a635d"}
Sep 18 17:14:52.678242 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.678213    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9" event={"ID":"a9d8b636-7912-400e-9d91-217d06d5fe41","Type":"ContainerStarted","Data":"f0192abac973d944ad72369bb5bc0f222ca609d5e9553f5bc6c35ed2c242ac6a"}
Sep 18 17:14:52.693035 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:52.692973    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-187.ec2.internal" podStartSLOduration=22.692960408 podStartE2EDuration="22.692960408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:52.692496609 +0000 UTC m=+24.634754217" watchObservedRunningTime="2026-09-18 17:14:52.692960408 +0000 UTC m=+24.635218019"
Sep 18 17:14:53.265785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.265757    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:53.266417 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.266399    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:53.551056 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.550989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:53.551211 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.550998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:53.551211 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:53.551094    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:53.551287 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:53.551223    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:53.683352 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.683317    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9" event={"ID":"a9d8b636-7912-400e-9d91-217d06d5fe41","Type":"ContainerStarted","Data":"8460eb30f6abe4b6741bdbeb243f60b030de515db72892f4990a20ef8242c681"}
Sep 18 17:14:53.686560 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.686540    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:14:53.686978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.686951    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"8e89cf923439685459274dd77d564bdcf580ce5c0610e4026ee29a9b1552042e"}
Sep 18 17:14:53.687542 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.687527    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w4ph9"
Sep 18 17:14:53.702093 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:53.702059    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knsv9" podStartSLOduration=3.156053043 podStartE2EDuration="24.702047135s" totalImagesPullingTime="21.545994092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:53.701574103 +0000 UTC m=+25.643831712" watchObservedRunningTime="2026-09-18 17:14:53.702047135 +0000 UTC m=+25.644304743"
Sep 18 17:14:54.551122 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:54.551080    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:54.551292 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:54.551201    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:55.550555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.550369    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:55.550984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.550384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:55.550984 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:55.550662    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:55.550984 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:55.550758    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:55.696073 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.696047    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:14:55.696842 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.696804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"bd3d6917a0df6c4252144b6ecb4ecaa87ffa59e81cde4293fba0aa51519d73d7"}
Sep 18 17:14:55.697294 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.697275    2584 scope.go:117] "RemoveContainer" containerID="f7bc4f421b5c6632c6cb8c7c73022e4b6fdf552c330a8557fc3a0b7714876458"
Sep 18 17:14:55.697549 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.697529    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:55.697626 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.697604    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:55.697689 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.697651    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:55.713545 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.713525    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:55.713688 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:55.713674    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:14:56.550740 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:56.550223    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:56.550740 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:56.550367    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:56.706400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:56.706372    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:14:56.706846 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:56.706812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" event={"ID":"f4b5fc06-218e-4769-a9f6-2b5e38768741","Type":"ContainerStarted","Data":"e7234562caa879649f6c30fe048eb932a8f6e984f705a9b35e8b2837fcb2e4e1"}
Sep 18 17:14:56.736161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:56.736081    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp" podStartSLOduration=8.380928959 podStartE2EDuration="27.736060625s" totalImagesPullingTime="19.355131666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:14:56.734658248 +0000 UTC m=+28.676915859" watchObservedRunningTime="2026-09-18 17:14:56.736060625 +0000 UTC m=+28.678318236"
Sep 18 17:14:57.000595 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.000567    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7f5hp"]
Sep 18 17:14:57.000739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.000622    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzv2v"]
Sep 18 17:14:57.000739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.000681    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:57.000842 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:57.000759    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:57.001156 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.001125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:57.001757 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:57.001292    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:57.001979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.001940    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqpwz"]
Sep 18 17:14:57.002161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:57.002043    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:57.002242 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:57.002160    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:58.551478    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:58.551623    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:58.552071    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:58.552250    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:58.552309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:14:58.553657 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:14:58.552409    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:14:58.711930 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:58.711905    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="4da5323414a146e3afdc7ca511c62cda2c6c0b54a5900c109f35edb83d2a6ed4" exitCode=0
Sep 18 17:14:58.712042 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:14:58.711937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"4da5323414a146e3afdc7ca511c62cda2c6c0b54a5900c109f35edb83d2a6ed4"}
Sep 18 17:15:00.550445 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:00.550281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:00.550786 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:00.550284    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:15:00.550786 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:00.550534    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:15:00.550786 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:00.550296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:00.550786 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:00.550609    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:15:00.550786 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:00.550683    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:15:00.718281 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:00.718253    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="72efd1591242182c7b56210b53d9ae64a4e60741d87423ebb53f1aafc76b7ba1" exitCode=0
Sep 18 17:15:00.718414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:00.718306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"72efd1591242182c7b56210b53d9ae64a4e60741d87423ebb53f1aafc76b7ba1"}
Sep 18 17:15:02.188375 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.188321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:02.188637 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.188463    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 17:15:02.188637 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.188526    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret podName:f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:34.188510853 +0000 UTC m=+66.130768444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret") pod "global-pull-secret-syncer-7f5hp" (UID: "f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662") : object "kube-system"/"original-pull-secret" not registered
Sep 18 17:15:02.289090 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.289065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:15:02.289190 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.289169    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:15:02.289232 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.289214    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:34.289200866 +0000 UTC m=+66.231458453 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 17:15:02.390254 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.390230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:02.390339 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.390318    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 17:15:02.390339 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.390329    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 17:15:02.390339 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.390338    2584 projected.go:196] Error preparing data for projected volume kube-api-access-7445d for pod openshift-network-diagnostics/network-check-target-hzv2v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:15:02.390440 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.390375    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d podName:ed5123e8-b1fe-4c7a-a0f4-de3316a8148a nodeName:}" failed. No retries permitted until 2026-09-18 17:15:34.390365182 +0000 UTC m=+66.332622770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7445d" (UniqueName: "kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d") pod "network-check-target-hzv2v" (UID: "ed5123e8-b1fe-4c7a-a0f4-de3316a8148a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 17:15:02.550533 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.550477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:15:02.550630 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.550476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:02.550630 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.550601    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqpwz" podUID="305ddf7d-642c-413e-91e4-64d8a6c1b972"
Sep 18 17:15:02.550740 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.550477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:02.550740 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.550649    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7f5hp" podUID="f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662"
Sep 18 17:15:02.550740 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:02.550712    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzv2v" podUID="ed5123e8-b1fe-4c7a-a0f4-de3316a8148a"
Sep 18 17:15:02.723859 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.723838    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="a6227683091325548fabcd0d6884413ad78708722f511e2a1e00a339180e0c61" exitCode=0
Sep 18 17:15:02.723952 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:02.723866    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"a6227683091325548fabcd0d6884413ad78708722f511e2a1e00a339180e0c61"}
Sep 18 17:15:03.338519 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.338492    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-187.ec2.internal" event="NodeReady"
Sep 18 17:15:03.338847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.338591    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 17:15:03.374967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.374906    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:15:03.394278 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.394254    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-88mkm"]
Sep 18 17:15:03.395169 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.394655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.397706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.397687    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 17:15:03.397804 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.397733    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 17:15:03.398310 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.398295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mr4mj\""
Sep 18 17:15:03.398489 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.398471    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 17:15:03.403521 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.403499    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 17:15:03.411200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.410587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:15:03.411200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.410623    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bj4hc"]
Sep 18 17:15:03.411200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.411178    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.414099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.414050    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 17:15:03.414099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.414099    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99knh\""
Sep 18 17:15:03.414398 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.414378    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 17:15:03.428769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.428745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88mkm"]
Sep 18 17:15:03.428857 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.428788    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bj4hc"]
Sep 18 17:15:03.428857 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.428848    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.432399 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.432167    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 17:15:03.432399 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.432384    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ddjzh\""
Sep 18 17:15:03.432536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.432385    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 17:15:03.432536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.432415    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 17:15:03.498972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.498950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499126 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.498993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499126 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499074    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499137    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499169    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499214    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499238    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.499403 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.499266    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknlr\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.558629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.558599    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4ph9_c0e49a0b-5a57-42df-8083-78563bf3056f/konnectivity-agent/0.log" limit=1024
Sep 18 17:15:03.600562 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600572    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whjg7\" (UniqueName: \"kubernetes.io/projected/6a1dd53a-cf41-4b05-971b-73025c85bd6e-kube-api-access-whjg7\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8wmh\" (UniqueName: \"kubernetes.io/projected/2d3d4997-1dcc-4594-8afc-5419330730ec-kube-api-access-l8wmh\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600663    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.600686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600686    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknlr\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600709    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a1dd53a-cf41-4b05-971b-73025c85bd6e-config-volume\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d4997-1dcc-4594-8afc-5419330730ec-cert\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600768    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a1dd53a-cf41-4b05-971b-73025c85bd6e-tmp-dir\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.601138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.600809    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.601527 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.601299    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.601971 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.601672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.601971 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.601879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.602132 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:03.602039    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:03.602132 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:03.602052    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:03.602242 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:03.602154    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:04.102132411 +0000 UTC m=+36.044390014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:03.605829 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.605810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.605917 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.605845    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.611604 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.611582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.611840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.611821    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknlr\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:03.701782 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whjg7\" (UniqueName: \"kubernetes.io/projected/6a1dd53a-cf41-4b05-971b-73025c85bd6e-kube-api-access-whjg7\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.701782 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701767    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8wmh\" (UniqueName: \"kubernetes.io/projected/2d3d4997-1dcc-4594-8afc-5419330730ec-kube-api-access-l8wmh\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.701925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a1dd53a-cf41-4b05-971b-73025c85bd6e-config-volume\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.701925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.701925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701876    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d4997-1dcc-4594-8afc-5419330730ec-cert\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.702080 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.701906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a1dd53a-cf41-4b05-971b-73025c85bd6e-tmp-dir\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.702080 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:03.701978    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:03.702080 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:03.702035    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:04.202017372 +0000 UTC m=+36.144274964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:03.702367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.702347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a1dd53a-cf41-4b05-971b-73025c85bd6e-tmp-dir\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.702508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.702490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6a1dd53a-cf41-4b05-971b-73025c85bd6e-config-volume\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.704485 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.704467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d3d4997-1dcc-4594-8afc-5419330730ec-cert\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.710946 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.710923    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whjg7\" (UniqueName: \"kubernetes.io/projected/6a1dd53a-cf41-4b05-971b-73025c85bd6e-kube-api-access-whjg7\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:03.711508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.711492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8wmh\" (UniqueName: \"kubernetes.io/projected/2d3d4997-1dcc-4594-8afc-5419330730ec-kube-api-access-l8wmh\") pod \"ingress-canary-bj4hc\" (UID: \"2d3d4997-1dcc-4594-8afc-5419330730ec\") " pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:03.737763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:03.737741    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bj4hc"
Sep 18 17:15:04.057006 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.056450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bj4hc"]
Sep 18 17:15:04.060213 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:15:04.060185    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3d4997_1dcc_4594_8afc_5419330730ec.slice/crio-fc4363026a3338d5b7315bfb7ad745995c5da4019a38c755a38bdcdcd403ba6e WatchSource:0}: Error finding container fc4363026a3338d5b7315bfb7ad745995c5da4019a38c755a38bdcdcd403ba6e: Status 404 returned error can't find the container with id fc4363026a3338d5b7315bfb7ad745995c5da4019a38c755a38bdcdcd403ba6e
Sep 18 17:15:04.106720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.106692    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:04.106837 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:04.106823    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:04.106882 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:04.106842    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:04.106930 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:04.106898    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:05.10688087 +0000 UTC m=+37.049138470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:04.207438 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.207410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:04.207573 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:04.207544    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:04.207624 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:04.207600    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:05.207587189 +0000 UTC m=+37.149844775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:04.551158 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.551124    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:04.551791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.551124    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:04.551791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.551138    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:15:04.554520 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.554501    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2h6n2\""
Sep 18 17:15:04.554640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.554536    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 17:15:04.556139 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.555471    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 17:15:04.556139 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.555476    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 17:15:04.556139 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.555758    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 17:15:04.556139 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.555960    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f2lgv\""
Sep 18 17:15:04.729315 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:04.729282    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bj4hc" event={"ID":"2d3d4997-1dcc-4594-8afc-5419330730ec","Type":"ContainerStarted","Data":"fc4363026a3338d5b7315bfb7ad745995c5da4019a38c755a38bdcdcd403ba6e"}
Sep 18 17:15:05.113487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:05.113460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:05.113652 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:05.113598    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:05.113652 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:05.113610    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:05.113766 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:05.113665    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:07.113645793 +0000 UTC m=+39.055903382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:05.214220 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:05.214183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:05.214352 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:05.214331    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:05.214394 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:05.214388    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:07.214371812 +0000 UTC m=+39.156629400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:06.691071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:06.691036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4ph9_c0e49a0b-5a57-42df-8083-78563bf3056f/konnectivity-agent/0.log" limit=1024
Sep 18 17:15:07.128643 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:07.128611    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:07.128776 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:07.128756    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:07.128776 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:07.128769    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:07.128865 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:07.128820    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:11.12880679 +0000 UTC m=+43.071064377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:07.229136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:07.229089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:07.229275 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:07.229218    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:07.229347 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:07.229279    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:11.229260561 +0000 UTC m=+43.171518333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:08.275783 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.275754    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4ph9_c0e49a0b-5a57-42df-8083-78563bf3056f/konnectivity-agent/0.log" limit=1024
Sep 18 17:15:08.376913 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.376829    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-w4ph9_c0e49a0b-5a57-42df-8083-78563bf3056f/konnectivity-agent/0.log" limit=1024
Sep 18 17:15:08.741291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.741263    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="2efff18e41554c88b31a45d4a9de78afe104f84e1dfff28b5e09ad7fdf82f291" exitCode=0
Sep 18 17:15:08.741440 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.741347    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"2efff18e41554c88b31a45d4a9de78afe104f84e1dfff28b5e09ad7fdf82f291"}
Sep 18 17:15:08.742950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.742927    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bj4hc" event={"ID":"2d3d4997-1dcc-4594-8afc-5419330730ec","Type":"ContainerStarted","Data":"47793b5067368c313e3971e8ee05324b4ea533462ceb40595a9702528922d092"}
Sep 18 17:15:08.783235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:08.783162    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bj4hc" podStartSLOduration=1.5478877309999999 podStartE2EDuration="5.783144717s" totalImagesPullingTime="4.235256986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:08.78220651 +0000 UTC m=+40.724464120" watchObservedRunningTime="2026-09-18 17:15:08.783144717 +0000 UTC m=+40.725402327"
Sep 18 17:15:09.748052 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:09.748021    2584 generic.go:356] "Generic (PLEG): container finished" podID="c9f18120-ba2e-4f22-a3c1-c9e5314309af" containerID="d1c87974fbec5554e4499434921d58cf1b414710b64c27a6f88f0720b67c2c57" exitCode=0
Sep 18 17:15:09.748419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:09.748124    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerDied","Data":"d1c87974fbec5554e4499434921d58cf1b414710b64c27a6f88f0720b67c2c57"}
Sep 18 17:15:10.753978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:10.753946    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pxb62" event={"ID":"c9f18120-ba2e-4f22-a3c1-c9e5314309af","Type":"ContainerStarted","Data":"63d72f4b63625aa8a7bee3b04f32b7560e907965a0f12ca8b174b2dc28d18467"}
Sep 18 17:15:10.781262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:10.781222    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pxb62" podStartSLOduration=8.411999344 podStartE2EDuration="41.781208611s" totalImagesPullingTime="33.369209267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:10.779818176 +0000 UTC m=+42.722075786" watchObservedRunningTime="2026-09-18 17:15:10.781208611 +0000 UTC m=+42.723466220"
Sep 18 17:15:11.160075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:11.160054    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:11.160195 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:11.160146    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:11.160195 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:11.160158    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:11.160276 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:11.160201    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:19.160188451 +0000 UTC m=+51.102446042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:11.260486 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:11.260463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:11.260683 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:11.260661    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:11.260776 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:11.260712    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:19.260701165 +0000 UTC m=+51.202958752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:19.211608 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:19.211574    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:19.211931 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:19.211696    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:19.211931 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:19.211708    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:19.211931 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:19.211765    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:15:35.21174755 +0000 UTC m=+67.154005151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:19.311951 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:19.311925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:19.312024 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:19.312013    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:19.312066 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:19.312056    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:15:35.312044428 +0000 UTC m=+67.254302019 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:27.719908 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:27.719880    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f9mxp"
Sep 18 17:15:34.212833 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.212799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:34.215697 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.215680    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 17:15:34.226599 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.226571    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662-original-pull-secret\") pod \"global-pull-secret-syncer-7f5hp\" (UID: \"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662\") " pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:34.271165 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.271142    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7f5hp"
Sep 18 17:15:34.313608 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.313577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:15:34.317060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.316735    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 17:15:34.324452 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:34.324430    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 17:15:34.324537 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:34.324499    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs podName:305ddf7d-642c-413e-91e4-64d8a6c1b972 nodeName:}" failed. No retries permitted until 2026-09-18 17:16:38.324478208 +0000 UTC m=+130.266735799 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs") pod "network-metrics-daemon-cqpwz" (UID: "305ddf7d-642c-413e-91e4-64d8a6c1b972") : secret "metrics-daemon-secret" not found
Sep 18 17:15:34.414693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.414666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:34.417708 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.417690    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 17:15:34.428046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.428025    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 17:15:34.437671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.437646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7445d\" (UniqueName: \"kubernetes.io/projected/ed5123e8-b1fe-4c7a-a0f4-de3316a8148a-kube-api-access-7445d\") pod \"network-check-target-hzv2v\" (UID: \"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a\") " pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:34.542204 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.542150    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7f5hp"]
Sep 18 17:15:34.545201 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:15:34.545169    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf73c23a6_fd1e_4a2d_a9d1_3468c4fa0662.slice/crio-8a7a35350778f13cc14a754ad0fd74ac43310055fde828b0a541fd395bbb9d58 WatchSource:0}: Error finding container 8a7a35350778f13cc14a754ad0fd74ac43310055fde828b0a541fd395bbb9d58: Status 404 returned error can't find the container with id 8a7a35350778f13cc14a754ad0fd74ac43310055fde828b0a541fd395bbb9d58
Sep 18 17:15:34.566816 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.566797    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f2lgv\""
Sep 18 17:15:34.575025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.575009    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:34.593532 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.593514    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"]
Sep 18 17:15:34.595545 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.595528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"
Sep 18 17:15:34.598645 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.598621    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 18 17:15:34.598743 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.598674    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gnr29\""
Sep 18 17:15:34.599258 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.599242    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 18 17:15:34.605765 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.605714    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"]
Sep 18 17:15:34.700050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.700018    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"]
Sep 18 17:15:34.701973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.701955    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:34.704719 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.704700    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 18 17:15:34.705018 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.704997    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 18 17:15:34.705289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.705273    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 18 17:15:34.705352 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.705340    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qkqp7\""
Sep 18 17:15:34.715474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.715453    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"]
Sep 18 17:15:34.716908 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.716889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lbhf\" (UniqueName: \"kubernetes.io/projected/fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7-kube-api-access-2lbhf\") pod \"volume-data-source-validator-5c4db8bdf9-l24tk\" (UID: \"fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"
Sep 18 17:15:34.806257 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.806194    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7f5hp" event={"ID":"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662","Type":"ContainerStarted","Data":"8a7a35350778f13cc14a754ad0fd74ac43310055fde828b0a541fd395bbb9d58"}
Sep 18 17:15:34.817472 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.817451    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8dpm\" (UniqueName: \"kubernetes.io/projected/d5569e88-efc7-4a59-90f2-cf392284d4da-kube-api-access-s8dpm\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:34.817547 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.817487    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:34.817547 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.817518    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lbhf\" (UniqueName: \"kubernetes.io/projected/fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7-kube-api-access-2lbhf\") pod \"volume-data-source-validator-5c4db8bdf9-l24tk\" (UID: \"fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"
Sep 18 17:15:34.825709 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.825692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lbhf\" (UniqueName: \"kubernetes.io/projected/fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7-kube-api-access-2lbhf\") pod \"volume-data-source-validator-5c4db8bdf9-l24tk\" (UID: \"fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"
Sep 18 17:15:34.846573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.846541    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzv2v"]
Sep 18 17:15:34.848818 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:15:34.848788    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded5123e8_b1fe_4c7a_a0f4_de3316a8148a.slice/crio-44489a59040ed3e39a71af96d876fb7a8f33b0470f774fd295e9270fb26fe884 WatchSource:0}: Error finding container 44489a59040ed3e39a71af96d876fb7a8f33b0470f774fd295e9270fb26fe884: Status 404 returned error can't find the container with id 44489a59040ed3e39a71af96d876fb7a8f33b0470f774fd295e9270fb26fe884
Sep 18 17:15:34.905306 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.905282    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"
Sep 18 17:15:34.918615 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.918589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:34.918739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.918694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8dpm\" (UniqueName: \"kubernetes.io/projected/d5569e88-efc7-4a59-90f2-cf392284d4da-kube-api-access-s8dpm\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:34.918739 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:34.918732    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 17:15:34.918822 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:34.918787    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls podName:d5569e88-efc7-4a59-90f2-cf392284d4da nodeName:}" failed. No retries permitted until 2026-09-18 17:15:35.418773133 +0000 UTC m=+67.361030720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xmmct" (UID: "d5569e88-efc7-4a59-90f2-cf392284d4da") : secret "samples-operator-tls" not found
Sep 18 17:15:34.929425 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:34.929405    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8dpm\" (UniqueName: \"kubernetes.io/projected/d5569e88-efc7-4a59-90f2-cf392284d4da-kube-api-access-s8dpm\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:35.173545 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.173511    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk"]
Sep 18 17:15:35.177326 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:15:35.177294    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd2c2f6_8d0e_4f27_98e1_d464ebcf4ef7.slice/crio-636b86b4f5f911b39d8b3b4582526bdcca6c6b8c801648a5355cb89b7a6a7f25 WatchSource:0}: Error finding container 636b86b4f5f911b39d8b3b4582526bdcca6c6b8c801648a5355cb89b7a6a7f25: Status 404 returned error can't find the container with id 636b86b4f5f911b39d8b3b4582526bdcca6c6b8c801648a5355cb89b7a6a7f25
Sep 18 17:15:35.222491 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.222464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:15:35.222852 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.222612    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 17:15:35.222852 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.222634    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-df78bc44f-gk5r4: secret "image-registry-tls" not found
Sep 18 17:15:35.222852 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.222691    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls podName:d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd nodeName:}" failed. No retries permitted until 2026-09-18 17:16:07.222674635 +0000 UTC m=+99.164932235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls") pod "image-registry-df78bc44f-gk5r4" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd") : secret "image-registry-tls" not found
Sep 18 17:15:35.323332 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.323295    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:15:35.323491 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.323462    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 17:15:35.323539 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.323510    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls podName:6a1dd53a-cf41-4b05-971b-73025c85bd6e nodeName:}" failed. No retries permitted until 2026-09-18 17:16:07.323497975 +0000 UTC m=+99.265755566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls") pod "dns-default-88mkm" (UID: "6a1dd53a-cf41-4b05-971b-73025c85bd6e") : secret "dns-default-metrics-tls" not found
Sep 18 17:15:35.424236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.424153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:35.424386 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.424318    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 17:15:35.424442 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:35.424388    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls podName:d5569e88-efc7-4a59-90f2-cf392284d4da nodeName:}" failed. No retries permitted until 2026-09-18 17:15:36.424368178 +0000 UTC m=+68.366625776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xmmct" (UID: "d5569e88-efc7-4a59-90f2-cf392284d4da") : secret "samples-operator-tls" not found
Sep 18 17:15:35.810674 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.810583    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk" event={"ID":"fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7","Type":"ContainerStarted","Data":"636b86b4f5f911b39d8b3b4582526bdcca6c6b8c801648a5355cb89b7a6a7f25"}
Sep 18 17:15:35.811944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:35.811912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzv2v" event={"ID":"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a","Type":"ContainerStarted","Data":"44489a59040ed3e39a71af96d876fb7a8f33b0470f774fd295e9270fb26fe884"}
Sep 18 17:15:36.432628 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:36.432589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:36.433084 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:36.432754    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 17:15:36.433084 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:36.432832    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls podName:d5569e88-efc7-4a59-90f2-cf392284d4da nodeName:}" failed. No retries permitted until 2026-09-18 17:15:38.432814611 +0000 UTC m=+70.375072220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xmmct" (UID: "d5569e88-efc7-4a59-90f2-cf392284d4da") : secret "samples-operator-tls" not found
Sep 18 17:15:36.816998 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:36.816882    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk" event={"ID":"fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7","Type":"ContainerStarted","Data":"416f1edeec4c36c21a286d3c157b5a0de6cc8dcd5042fd11d85963fde3acfe3b"}
Sep 18 17:15:38.448001 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:38.447966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:38.448455 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:38.448132    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 17:15:38.448455 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:38.448205    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls podName:d5569e88-efc7-4a59-90f2-cf392284d4da nodeName:}" failed. No retries permitted until 2026-09-18 17:15:42.448185238 +0000 UTC m=+74.390442839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xmmct" (UID: "d5569e88-efc7-4a59-90f2-cf392284d4da") : secret "samples-operator-tls" not found
Sep 18 17:15:38.998797 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:38.998739    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-l24tk" podStartSLOduration=3.650417079 podStartE2EDuration="4.998721599s" totalImagesPullingTime="1.34830452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:36.849671715 +0000 UTC m=+68.791929323" watchObservedRunningTime="2026-09-18 17:15:38.998721599 +0000 UTC m=+70.940979231"
Sep 18 17:15:38.998975 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:38.998874    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7w7s9"]
Sep 18 17:15:39.013966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.013944    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.016026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.015995    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7w7s9"]
Sep 18 17:15:39.017340 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.017319    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 17:15:39.017718 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.017700    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 17:15:39.017966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.017950    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 17:15:39.018505 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.018483    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 17:15:39.020635 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.020612    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2sl55\""
Sep 18 17:15:39.052677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.052617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.052778 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.052764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb9640f9-2535-48d9-b744-fa921e4ed9b6-crio-socket\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.052866 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.052786    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb9640f9-2535-48d9-b744-fa921e4ed9b6-data-volume\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.052866 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.052814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.052866 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.052844    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndgjh\" (UniqueName: \"kubernetes.io/projected/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-api-access-ndgjh\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154013 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.153982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb9640f9-2535-48d9-b744-fa921e4ed9b6-crio-socket\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb9640f9-2535-48d9-b744-fa921e4ed9b6-data-volume\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndgjh\" (UniqueName: \"kubernetes.io/projected/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-api-access-ndgjh\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154131    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb9640f9-2535-48d9-b744-fa921e4ed9b6-crio-socket\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.154385 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.154210    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 17:15:39.154385 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.154219    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:39.154385 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.154281    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:39.654260941 +0000 UTC m=+71.596518531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : configmap "kube-rbac-proxy" not found
Sep 18 17:15:39.154385 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.154299    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:39.654289383 +0000 UTC m=+71.596546974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:39.154560 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.154401    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb9640f9-2535-48d9-b744-fa921e4ed9b6-data-volume\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.167051 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.167030    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndgjh\" (UniqueName: \"kubernetes.io/projected/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-api-access-ndgjh\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.658816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.658901    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.659073    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.659155    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:40.659136821 +0000 UTC m=+72.601394423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : configmap "kube-rbac-proxy" not found
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.659652    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:39.662818 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:39.659706    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:40.659691569 +0000 UTC m=+72.601949171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:39.826303 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.826263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7f5hp" event={"ID":"f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662","Type":"ContainerStarted","Data":"3f5f067f49dda2ae7512114551a8fc3e3d00a429d2037f57e25382ba72002693"}
Sep 18 17:15:39.827864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.827839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzv2v" event={"ID":"ed5123e8-b1fe-4c7a-a0f4-de3316a8148a","Type":"ContainerStarted","Data":"60f3d35f44f670e06821fb12f3057a9c48776611a0a1ca9fde5d3a551f7343d5"}
Sep 18 17:15:39.828001 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.827972    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:15:39.845700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.845655    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7f5hp" podStartSLOduration=65.778892466 podStartE2EDuration="1m10.845639153s" totalImagesPullingTime="5.066746687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:39.845521727 +0000 UTC m=+71.787779336" watchObservedRunningTime="2026-09-18 17:15:39.845639153 +0000 UTC m=+71.787896763"
Sep 18 17:15:39.861723 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:39.861651    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzv2v" podStartSLOduration=66.099887749 podStartE2EDuration="1m10.861638501s" totalImagesPullingTime="4.761750752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:39.86087021 +0000 UTC m=+71.803127819" watchObservedRunningTime="2026-09-18 17:15:39.861638501 +0000 UTC m=+71.803896110"
Sep 18 17:15:40.667099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:40.667061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:40.667516 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:40.667131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:40.667516 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:40.667219    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:40.667516 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:40.667247    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 17:15:40.667516 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:40.667289    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:42.667272563 +0000 UTC m=+74.609530151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:40.667516 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:40.667306    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:42.667299381 +0000 UTC m=+74.609556967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : configmap "kube-rbac-proxy" not found
Sep 18 17:15:40.915952 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:40.915928    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd2vh_d617eb0a-3bb5-40c9-90e4-b246d680118e/dns-node-resolver/0.log"
Sep 18 17:15:41.708075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:41.708048    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2f7l9_93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55/node-ca/0.log"
Sep 18 17:15:42.479992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:42.479956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:42.480176 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.480126    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 17:15:42.480231 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.480194    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls podName:d5569e88-efc7-4a59-90f2-cf392284d4da nodeName:}" failed. No retries permitted until 2026-09-18 17:15:50.480178493 +0000 UTC m=+82.422436080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-xmmct" (UID: "d5569e88-efc7-4a59-90f2-cf392284d4da") : secret "samples-operator-tls" not found
Sep 18 17:15:42.508511 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:42.508485    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bj4hc_2d3d4997-1dcc-4594-8afc-5419330730ec/serve-healthcheck-canary/0.log"
Sep 18 17:15:42.681663 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:42.681621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:42.681821 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.681741    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 17:15:42.681821 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:42.681757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:42.681821 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.681791    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:46.681778386 +0000 UTC m=+78.624035972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : configmap "kube-rbac-proxy" not found
Sep 18 17:15:42.682003 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.681881    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:42.682003 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:42.681952    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:46.681934017 +0000 UTC m=+78.624191648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:44.833196 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.833157    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ckxbc"]
Sep 18 17:15:44.835304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.835284    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.838213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.838186    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 18 17:15:44.839223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.839195    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 18 17:15:44.839501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.839260    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 18 17:15:44.839651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.839261    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 18 17:15:44.839651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.839372    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bvbhp\""
Sep 18 17:15:44.845578 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.845547    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ckxbc"]
Sep 18 17:15:44.896676 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.896651    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-cabundle\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.896784 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.896690    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb96f\" (UniqueName: \"kubernetes.io/projected/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-kube-api-access-jb96f\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.896784 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.896769    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-key\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.998056 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.998028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-key\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.998194 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.998086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-cabundle\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.998194 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.998132    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb96f\" (UniqueName: \"kubernetes.io/projected/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-kube-api-access-jb96f\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:44.998813 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:44.998790    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-cabundle\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:45.000851 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:45.000813    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-signing-key\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:45.007979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:45.007956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb96f\" (UniqueName: \"kubernetes.io/projected/6fc9a8db-4ba0-4cef-85d9-50c1ad162371-kube-api-access-jb96f\") pod \"service-ca-55f6fc7b86-ckxbc\" (UID: \"6fc9a8db-4ba0-4cef-85d9-50c1ad162371\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:45.149301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:45.149265    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc"
Sep 18 17:15:45.425004 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:45.424923    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ckxbc"]
Sep 18 17:15:45.428782 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:15:45.428754    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc9a8db_4ba0_4cef_85d9_50c1ad162371.slice/crio-80dae38186739bd641f1cfb60b9edc91abe18c403832b9314d74dd28f892e540 WatchSource:0}: Error finding container 80dae38186739bd641f1cfb60b9edc91abe18c403832b9314d74dd28f892e540: Status 404 returned error can't find the container with id 80dae38186739bd641f1cfb60b9edc91abe18c403832b9314d74dd28f892e540
Sep 18 17:15:45.844954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:45.844874    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc" event={"ID":"6fc9a8db-4ba0-4cef-85d9-50c1ad162371","Type":"ContainerStarted","Data":"80dae38186739bd641f1cfb60b9edc91abe18c403832b9314d74dd28f892e540"}
Sep 18 17:15:46.712735 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:46.712699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:46.712917 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:46.712820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:46.712917 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:46.712823    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 17:15:46.713147 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:46.712922    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:54.712902875 +0000 UTC m=+86.655160483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : configmap "kube-rbac-proxy" not found
Sep 18 17:15:46.713147 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:46.712962    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:46.713147 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:46.713067    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:15:54.71304642 +0000 UTC m=+86.655304011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:47.852419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:47.852379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc" event={"ID":"6fc9a8db-4ba0-4cef-85d9-50c1ad162371","Type":"ContainerStarted","Data":"8777f41dde9fc6acfa646b2943a38235d10abc2c6da2d88dff80389364b78fba"}
Sep 18 17:15:47.871084 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:47.871035    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-ckxbc" podStartSLOduration=2.279328678 podStartE2EDuration="3.871019072s" totalImagesPullingTime="1.591690394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:47.869868496 +0000 UTC m=+79.812126106" watchObservedRunningTime="2026-09-18 17:15:47.871019072 +0000 UTC m=+79.813276681"
Sep 18 17:15:50.542890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:50.542753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:50.545475 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:50.545447    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d5569e88-efc7-4a59-90f2-cf392284d4da-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-xmmct\" (UID: \"d5569e88-efc7-4a59-90f2-cf392284d4da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:50.610683 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:50.610656    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"
Sep 18 17:15:50.883349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:50.883241    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct"]
Sep 18 17:15:51.867841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:51.867805    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct" event={"ID":"d5569e88-efc7-4a59-90f2-cf392284d4da","Type":"ContainerStarted","Data":"1841ef25788a3cd52baf7575b9019985d7378fb590fe1ae257647b85779f3aee"}
Sep 18 17:15:52.872947 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:52.872911    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct" event={"ID":"d5569e88-efc7-4a59-90f2-cf392284d4da","Type":"ContainerStarted","Data":"a494308734458df1e313dc4578a2fbdc01e0fbe8449912fb346933b7562d5418"}
Sep 18 17:15:52.873344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:52.872973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct" event={"ID":"d5569e88-efc7-4a59-90f2-cf392284d4da","Type":"ContainerStarted","Data":"54757f44fd1db682b37f725fd8e1f2621dca5d1d169ef0a053f6dfdc834777bf"}
Sep 18 17:15:52.891366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:52.891322    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-xmmct" podStartSLOduration=17.401828763 podStartE2EDuration="18.891306657s" totalImagesPullingTime="1.489477894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:15:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:15:52.891187108 +0000 UTC m=+84.833444717" watchObservedRunningTime="2026-09-18 17:15:52.891306657 +0000 UTC m=+84.833564266"
Sep 18 17:15:54.776631 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:54.776589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:54.776631 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:54.776632    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:15:54.777083 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:54.776736    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:54.777083 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:15:54.776803    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls podName:fb9640f9-2535-48d9-b744-fa921e4ed9b6 nodeName:}" failed. No retries permitted until 2026-09-18 17:16:10.776788485 +0000 UTC m=+102.719046072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7w7s9" (UID: "fb9640f9-2535-48d9-b744-fa921e4ed9b6") : secret "insights-runtime-extractor-tls" not found
Sep 18 17:15:54.777205 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:15:54.777082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb9640f9-2535-48d9-b744-fa921e4ed9b6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:16:04.235609 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.235571    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"]
Sep 18 17:16:04.238347 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.238332    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.245063 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.245041    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 18 17:16:04.245844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.245822    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 18 17:16:04.246671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.246653    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 18 17:16:04.247449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.247435    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 18 17:16:04.247552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.247470    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 18 17:16:04.249588 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.249573    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 18 17:16:04.250148 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.250132    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 18 17:16:04.264487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.264467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"]
Sep 18 17:16:04.348677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348650    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.348840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.348840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348702    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.348840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348720    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9353a-8328-466a-b4de-53e47cc17d9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.348840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.348982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.348897    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpkkt\" (UniqueName: \"kubernetes.io/projected/5dd9353a-8328-466a-b4de-53e47cc17d9d-kube-api-access-mpkkt\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.449811 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.449779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpkkt\" (UniqueName: \"kubernetes.io/projected/5dd9353a-8328-466a-b4de-53e47cc17d9d-kube-api-access-mpkkt\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.449834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.449925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.449965    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.449993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9353a-8328-466a-b4de-53e47cc17d9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.450035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.450990 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.450959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd9353a-8328-466a-b4de-53e47cc17d9d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.452633 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.452614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.452753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.452734    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-ca\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.452839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.452823    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.452923 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.452904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5dd9353a-8328-466a-b4de-53e47cc17d9d-hub\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.459912 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.459887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpkkt\" (UniqueName: \"kubernetes.io/projected/5dd9353a-8328-466a-b4de-53e47cc17d9d-kube-api-access-mpkkt\") pod \"cluster-proxy-proxy-agent-5bbfcf495-s5rlw\" (UID: \"5dd9353a-8328-466a-b4de-53e47cc17d9d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.556949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.556877    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"
Sep 18 17:16:04.842871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.842772    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw"]
Sep 18 17:16:04.846952 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:04.846927    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd9353a_8328_466a_b4de_53e47cc17d9d.slice/crio-da5335b69dac2578d3c362bef1d9a4bed246db45aa251c141291f3a924e6d1b9 WatchSource:0}: Error finding container da5335b69dac2578d3c362bef1d9a4bed246db45aa251c141291f3a924e6d1b9: Status 404 returned error can't find the container with id da5335b69dac2578d3c362bef1d9a4bed246db45aa251c141291f3a924e6d1b9
Sep 18 17:16:04.912786 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:04.912746    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw" event={"ID":"5dd9353a-8328-466a-b4de-53e47cc17d9d","Type":"ContainerStarted","Data":"da5335b69dac2578d3c362bef1d9a4bed246db45aa251c141291f3a924e6d1b9"}
Sep 18 17:16:07.274443 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.274409    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:07.276960 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.276937    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"image-registry-df78bc44f-gk5r4\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") " pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:07.308949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.308907    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mr4mj\""
Sep 18 17:16:07.316592 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.316572    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:07.375679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.375647    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:16:07.377973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.377951    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a1dd53a-cf41-4b05-971b-73025c85bd6e-metrics-tls\") pod \"dns-default-88mkm\" (UID: \"6a1dd53a-cf41-4b05-971b-73025c85bd6e\") " pod="openshift-dns/dns-default-88mkm"
Sep 18 17:16:07.589921 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.589863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:16:07.592285 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:07.592260    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b6f40a_c1a4_4b95_a5db_d9dc50c502bd.slice/crio-ec50c642cf1516989b7734f1f5ee86ed2b1482ffbe45c73ccfa348f6c0cdeed0 WatchSource:0}: Error finding container ec50c642cf1516989b7734f1f5ee86ed2b1482ffbe45c73ccfa348f6c0cdeed0: Status 404 returned error can't find the container with id ec50c642cf1516989b7734f1f5ee86ed2b1482ffbe45c73ccfa348f6c0cdeed0
Sep 18 17:16:07.625333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.625312    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99knh\""
Sep 18 17:16:07.632721 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.632699    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-88mkm"
Sep 18 17:16:07.913627 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.913544    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-88mkm"]
Sep 18 17:16:07.917230 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:07.917200    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1dd53a_cf41_4b05_971b_73025c85bd6e.slice/crio-f22d94e8d66d8a78775b27e27b505ce2acc890e5a9a355f804d71cdef1d8b0bc WatchSource:0}: Error finding container f22d94e8d66d8a78775b27e27b505ce2acc890e5a9a355f804d71cdef1d8b0bc: Status 404 returned error can't find the container with id f22d94e8d66d8a78775b27e27b505ce2acc890e5a9a355f804d71cdef1d8b0bc
Sep 18 17:16:07.925695 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.925668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" event={"ID":"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd","Type":"ContainerStarted","Data":"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"}
Sep 18 17:16:07.925801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.925720    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" event={"ID":"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd","Type":"ContainerStarted","Data":"ec50c642cf1516989b7734f1f5ee86ed2b1482ffbe45c73ccfa348f6c0cdeed0"}
Sep 18 17:16:07.925801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.925779    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:07.927396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.927376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88mkm" event={"ID":"6a1dd53a-cf41-4b05-971b-73025c85bd6e","Type":"ContainerStarted","Data":"f22d94e8d66d8a78775b27e27b505ce2acc890e5a9a355f804d71cdef1d8b0bc"}
Sep 18 17:16:07.947126 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:07.947062    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" podStartSLOduration=76.947048168 podStartE2EDuration="1m16.947048168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:07.946191148 +0000 UTC m=+99.888448756" watchObservedRunningTime="2026-09-18 17:16:07.947048168 +0000 UTC m=+99.889305776"
Sep 18 17:16:09.935919 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:09.935872    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88mkm" event={"ID":"6a1dd53a-cf41-4b05-971b-73025c85bd6e","Type":"ContainerStarted","Data":"991dda2bd38292f7d10b0143e77d505a8f22bc8c98c42042833338297eab8957"}
Sep 18 17:16:09.936371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:09.935937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-88mkm" event={"ID":"6a1dd53a-cf41-4b05-971b-73025c85bd6e","Type":"ContainerStarted","Data":"577fc87bd8d223fd138b40876c78479a2f782f62cccb604318c1acc6c2b67b32"}
Sep 18 17:16:09.936371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:09.936023    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-88mkm"
Sep 18 17:16:09.954995 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:09.954938    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-88mkm" podStartSLOduration=65.435283891 podStartE2EDuration="1m6.954921009s" totalImagesPullingTime="1.519637118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:09.954352264 +0000 UTC m=+101.896609876" watchObservedRunningTime="2026-09-18 17:16:09.954921009 +0000 UTC m=+101.897178619"
Sep 18 17:16:10.803436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:10.803394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:16:10.805886 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:10.805859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb9640f9-2535-48d9-b744-fa921e4ed9b6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7w7s9\" (UID: \"fb9640f9-2535-48d9-b744-fa921e4ed9b6\") " pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:16:10.825938 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:10.825912    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7w7s9"
Sep 18 17:16:10.833372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:10.833350    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzv2v"
Sep 18 17:16:12.248428 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.248363    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7w7s9"]
Sep 18 17:16:12.380021 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:12.379985    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9640f9_2535_48d9_b744_fa921e4ed9b6.slice/crio-d4aa46e61b39ca1d5761ffea6a063714e39bbafd47ab966555dbff4362918b2a WatchSource:0}: Error finding container d4aa46e61b39ca1d5761ffea6a063714e39bbafd47ab966555dbff4362918b2a: Status 404 returned error can't find the container with id d4aa46e61b39ca1d5761ffea6a063714e39bbafd47ab966555dbff4362918b2a
Sep 18 17:16:12.948860 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.948819    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw" event={"ID":"5dd9353a-8328-466a-b4de-53e47cc17d9d","Type":"ContainerStarted","Data":"020909f7430cddd001917521af9d1c7cabc018c8a44aa016bbb0b8abe52aab4e"}
Sep 18 17:16:12.949040 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.948871    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw" event={"ID":"5dd9353a-8328-466a-b4de-53e47cc17d9d","Type":"ContainerStarted","Data":"7f46ff7c4cd08653557c43035547efc72b58c0967796bb1667ccbbbe188795e3"}
Sep 18 17:16:12.949040 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.948886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw" event={"ID":"5dd9353a-8328-466a-b4de-53e47cc17d9d","Type":"ContainerStarted","Data":"5662793bc2487066a488ff72a5d013254cedb162c8d88a3329273c2384c1e933"}
Sep 18 17:16:12.950249 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.950225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w7s9" event={"ID":"fb9640f9-2535-48d9-b744-fa921e4ed9b6","Type":"ContainerStarted","Data":"1d4d0d7384db1f29d94bc50ff6fdc29fe1bdaf22b7b5ca91aed16223d2ba88ce"}
Sep 18 17:16:12.950344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.950273    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w7s9" event={"ID":"fb9640f9-2535-48d9-b744-fa921e4ed9b6","Type":"ContainerStarted","Data":"d4aa46e61b39ca1d5761ffea6a063714e39bbafd47ab966555dbff4362918b2a"}
Sep 18 17:16:12.971175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:12.971126    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bbfcf495-s5rlw" podStartSLOduration=1.394712348 podStartE2EDuration="8.971090616s" totalImagesPullingTime="7.576378268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:12.969867395 +0000 UTC m=+104.912124998" watchObservedRunningTime="2026-09-18 17:16:12.971090616 +0000 UTC m=+104.913348226"
Sep 18 17:16:13.955888 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:13.955797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w7s9" event={"ID":"fb9640f9-2535-48d9-b744-fa921e4ed9b6","Type":"ContainerStarted","Data":"65973cfa60fe1282552d21667a5eac636fd4dac92115a784da4bb153cbcc6b7f"}
Sep 18 17:16:15.965699 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:15.965661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7w7s9" event={"ID":"fb9640f9-2535-48d9-b744-fa921e4ed9b6","Type":"ContainerStarted","Data":"63809cc2c4c90119ed152bde777fd36a1ec086614f2bd38aef6d616762f538e7"}
Sep 18 17:16:15.986572 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:15.986516    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7w7s9" podStartSLOduration=35.62286068 podStartE2EDuration="37.98650171s" totalImagesPullingTime="2.36364103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:15:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:15.985430992 +0000 UTC m=+107.927688600" watchObservedRunningTime="2026-09-18 17:16:15.98650171 +0000 UTC m=+107.928759319"
Sep 18 17:16:19.943454 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:19.943423    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-88mkm"
Sep 18 17:16:26.206275 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:26.206240    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:16:26.210476 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:26.210455    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:30.491777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.491743    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g8lth"]
Sep 18 17:16:30.495236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.495219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.498366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.498337    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 17:16:30.498954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.498935    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 17:16:30.499094 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.499072    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 17:16:30.499236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.499219    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 17:16:30.499472 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.499458    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 17:16:30.499804 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.499790    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 17:16:30.500026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.500014    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jmw5s\""
Sep 18 17:16:30.539199 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-wtmp\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539214    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-root\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-textfile\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75qq\" (UniqueName: \"kubernetes.io/projected/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-kube-api-access-l75qq\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-tls\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539365    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-metrics-client-ca\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539385    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-sys\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.539449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.539443    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.639859 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.639830    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-sys\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.639965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.639870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.639965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.639930    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-sys\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.639965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.639933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-wtmp\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.639990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-root\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640020    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-textfile\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75qq\" (UniqueName: \"kubernetes.io/projected/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-kube-api-access-l75qq\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640040    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-root\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-tls\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640134 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-wtmp\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-metrics-client-ca\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-textfile\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640787 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640766    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.640839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.640807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-metrics-client-ca\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.642238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.642218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.642496 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.642477    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-node-exporter-tls\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.648766 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.648742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75qq\" (UniqueName: \"kubernetes.io/projected/83dd1def-794e-43f2-ab7f-b7a63c26c0d1-kube-api-access-l75qq\") pod \"node-exporter-g8lth\" (UID: \"83dd1def-794e-43f2-ab7f-b7a63c26c0d1\") " pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.805184 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:30.805121    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g8lth"
Sep 18 17:16:30.815712 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:30.815684    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83dd1def_794e_43f2_ab7f_b7a63c26c0d1.slice/crio-90d8666604ed061b79a33e4369c75c3e77af54179e4fdc00b0f2215695f48530 WatchSource:0}: Error finding container 90d8666604ed061b79a33e4369c75c3e77af54179e4fdc00b0f2215695f48530: Status 404 returned error can't find the container with id 90d8666604ed061b79a33e4369c75c3e77af54179e4fdc00b0f2215695f48530
Sep 18 17:16:31.014544 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:31.014514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8lth" event={"ID":"83dd1def-794e-43f2-ab7f-b7a63c26c0d1","Type":"ContainerStarted","Data":"90d8666604ed061b79a33e4369c75c3e77af54179e4fdc00b0f2215695f48530"}
Sep 18 17:16:32.020346 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:32.020312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8lth" event={"ID":"83dd1def-794e-43f2-ab7f-b7a63c26c0d1","Type":"ContainerStarted","Data":"39e573c3c8cafa8dede43f7166fa28b1141c71bfed5099fe1db97df710a7945e"}
Sep 18 17:16:33.025265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:33.025231    2584 generic.go:356] "Generic (PLEG): container finished" podID="83dd1def-794e-43f2-ab7f-b7a63c26c0d1" containerID="39e573c3c8cafa8dede43f7166fa28b1141c71bfed5099fe1db97df710a7945e" exitCode=0
Sep 18 17:16:33.025617 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:33.025317    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8lth" event={"ID":"83dd1def-794e-43f2-ab7f-b7a63c26c0d1","Type":"ContainerDied","Data":"39e573c3c8cafa8dede43f7166fa28b1141c71bfed5099fe1db97df710a7945e"}
Sep 18 17:16:34.030674 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:34.030632    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8lth" event={"ID":"83dd1def-794e-43f2-ab7f-b7a63c26c0d1","Type":"ContainerStarted","Data":"796ccd990ea8618a1207d8a68be0da3b9bc2a68e43642a4c18b1a93630ddd06b"}
Sep 18 17:16:34.031095 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:34.030695    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g8lth" event={"ID":"83dd1def-794e-43f2-ab7f-b7a63c26c0d1","Type":"ContainerStarted","Data":"fc9254ab7a29a14ea3c95d5a869922bba8ac743d46a6cb7b35813d1024a109d9"}
Sep 18 17:16:34.056277 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:34.056238    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g8lth" podStartSLOduration=2.9040865030000003 podStartE2EDuration="4.056224018s" totalImagesPullingTime="1.081534547s" totalInitContainerRuntime="70.602968ms" isStatefulPod=true podCreationTimestamp="2026-09-18 17:16:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:34.053965649 +0000 UTC m=+125.996223258" watchObservedRunningTime="2026-09-18 17:16:34.056224018 +0000 UTC m=+125.998481626"
Sep 18 17:16:38.393175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:38.393130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:16:38.395513 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:38.395492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/305ddf7d-642c-413e-91e4-64d8a6c1b972-metrics-certs\") pod \"network-metrics-daemon-cqpwz\" (UID: \"305ddf7d-642c-413e-91e4-64d8a6c1b972\") " pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:16:38.481020 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:38.480998    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2h6n2\""
Sep 18 17:16:38.488279 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:38.488263    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqpwz"
Sep 18 17:16:38.759511 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:38.759447    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqpwz"]
Sep 18 17:16:38.762089 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:16:38.762059    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod305ddf7d_642c_413e_91e4_64d8a6c1b972.slice/crio-cee353f78d4c97320bf699be461862875f62d75f057d7fa81c18ebdcb6fb971f WatchSource:0}: Error finding container cee353f78d4c97320bf699be461862875f62d75f057d7fa81c18ebdcb6fb971f: Status 404 returned error can't find the container with id cee353f78d4c97320bf699be461862875f62d75f057d7fa81c18ebdcb6fb971f
Sep 18 17:16:39.046367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:39.046295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqpwz" event={"ID":"305ddf7d-642c-413e-91e4-64d8a6c1b972","Type":"ContainerStarted","Data":"cee353f78d4c97320bf699be461862875f62d75f057d7fa81c18ebdcb6fb971f"}
Sep 18 17:16:40.051429 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:40.051351    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqpwz" event={"ID":"305ddf7d-642c-413e-91e4-64d8a6c1b972","Type":"ContainerStarted","Data":"fafb03bc88986b73eb9fe672f90d5e2e164d3caad2107e888858ee344d256872"}
Sep 18 17:16:40.051429 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:40.051415    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqpwz" event={"ID":"305ddf7d-642c-413e-91e4-64d8a6c1b972","Type":"ContainerStarted","Data":"034ab006978ac513a371205ebc6a18f6941b70a8756e7835fbff7f01089944a8"}
Sep 18 17:16:40.078672 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:40.078626    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cqpwz" podStartSLOduration=130.184672938 podStartE2EDuration="2m11.078610468s" totalImagesPullingTime="893.93753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:16:40.07682188 +0000 UTC m=+132.019079488" watchObservedRunningTime="2026-09-18 17:16:40.078610468 +0000 UTC m=+132.020868076"
Sep 18 17:16:48.937643 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:48.937604    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bj4hc_2d3d4997-1dcc-4594-8afc-5419330730ec/serve-healthcheck-canary/0.log"
Sep 18 17:16:51.225033 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.224975    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" podUID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" containerName="registry" containerID="cri-o://6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61" gracePeriod=30
Sep 18 17:16:51.466220 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.466198    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:51.578355 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578298    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578355 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578328    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578355 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dknlr\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578591 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578391    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578591 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578595    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578644    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578671    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted\") pod \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\" (UID: \"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd\") "
Sep 18 17:16:51.578863 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.578736    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:16:51.579435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.579171    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:16:51.579435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.579386    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-trusted-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.579435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.579409    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-certificates\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.581234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.581203    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:16:51.581234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.581214    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:16:51.581384 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.581280    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:16:51.581480 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.581455    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr" (OuterVolumeSpecName: "kube-api-access-dknlr") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "kube-api-access-dknlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:16:51.581987 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.581961    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:16:51.587865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.587842    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" (UID: "d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:16:51.680183 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680163    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-registry-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.680183 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680181    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-installation-pull-secrets\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.680308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680190    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-ca-trust-extracted\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.680308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680200    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-image-registry-private-configuration\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.680308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680209    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dknlr\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-kube-api-access-dknlr\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:51.680308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:51.680217    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd-bound-sa-token\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:16:52.098428 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.098391    2584 generic.go:356] "Generic (PLEG): container finished" podID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" containerID="6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61" exitCode=0
Sep 18 17:16:52.098552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.098439    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4"
Sep 18 17:16:52.098552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.098493    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" event={"ID":"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd","Type":"ContainerDied","Data":"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"}
Sep 18 17:16:52.098552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.098546    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-df78bc44f-gk5r4" event={"ID":"d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd","Type":"ContainerDied","Data":"ec50c642cf1516989b7734f1f5ee86ed2b1482ffbe45c73ccfa348f6c0cdeed0"}
Sep 18 17:16:52.098665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.098581    2584 scope.go:117] "RemoveContainer" containerID="6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"
Sep 18 17:16:52.107815 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.107795    2584 scope.go:117] "RemoveContainer" containerID="6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"
Sep 18 17:16:52.108122 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:16:52.108080    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61\": container with ID starting with 6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61 not found: ID does not exist" containerID="6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"
Sep 18 17:16:52.108203 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.108159    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61"} err="failed to get container status \"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61\": rpc error: code = NotFound desc = could not find container \"6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61\": container with ID starting with 6ea0b449b99bf98b70066aee920c65e7ab9d71c5b09d74f2606af15a0d9ebb61 not found: ID does not exist"
Sep 18 17:16:52.122389 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.122363    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:16:52.127364 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.127340    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-df78bc44f-gk5r4"]
Sep 18 17:16:52.555370 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:16:52.555299    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" path="/var/lib/kubelet/pods/d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd/volumes"
Sep 18 17:18:56.542587 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.542513    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"]
Sep 18 17:18:56.543026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.542770    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" containerName="registry"
Sep 18 17:18:56.543026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.542782    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" containerName="registry"
Sep 18 17:18:56.543026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.542824    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b6f40a-c1a4-4b95-a5db-d9dc50c502bd" containerName="registry"
Sep 18 17:18:56.544565 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.544547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.547476 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.547448    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 17:18:56.547476 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.547455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 17:18:56.547644 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.547572    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ft7jf\""
Sep 18 17:18:56.556548 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.556527    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"]
Sep 18 17:18:56.592304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.592277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq46g\" (UniqueName: \"kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.592428 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.592331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.592492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.592458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.693700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.693676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.693804 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.693713    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.693804 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.693738    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq46g\" (UniqueName: \"kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.694008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.693989    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.694048 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.694027    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.703440 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.703410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq46g\" (UniqueName: \"kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:56.854708 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:56.854683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:18:57.131414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:57.131390    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"]
Sep 18 17:18:57.133841 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:18:57.133813    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25992ac2_65c2_4263_8a2b_5cec01e75c50.slice/crio-b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f WatchSource:0}: Error finding container b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f: Status 404 returned error can't find the container with id b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f
Sep 18 17:18:57.538635 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:18:57.538563    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll" event={"ID":"25992ac2-65c2-4263-8a2b-5cec01e75c50","Type":"ContainerStarted","Data":"b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f"}
Sep 18 17:19:03.563319 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:03.563277    2584 generic.go:356] "Generic (PLEG): container finished" podID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerID="bbe356b832a0adf811e1cff0c46204d20e98f46888c9ee5d68afca01be0aa3bb" exitCode=0
Sep 18 17:19:03.563654 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:03.563357    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll" event={"ID":"25992ac2-65c2-4263-8a2b-5cec01e75c50","Type":"ContainerDied","Data":"bbe356b832a0adf811e1cff0c46204d20e98f46888c9ee5d68afca01be0aa3bb"}
Sep 18 17:19:05.571470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:05.571438    2584 generic.go:356] "Generic (PLEG): container finished" podID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerID="1ab8a8caf63824eb8988d0637ea9be2948e78094ab0faecb9f1f967b6fd69de4" exitCode=0
Sep 18 17:19:05.571757 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:05.571496    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll" event={"ID":"25992ac2-65c2-4263-8a2b-5cec01e75c50","Type":"ContainerDied","Data":"1ab8a8caf63824eb8988d0637ea9be2948e78094ab0faecb9f1f967b6fd69de4"}
Sep 18 17:19:12.597414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:12.597373    2584 generic.go:356] "Generic (PLEG): container finished" podID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerID="0b5e9fedb6a33561ec5062de3593affb7d953f354897642921651a0038638515" exitCode=0
Sep 18 17:19:12.597752 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:12.597470    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll" event={"ID":"25992ac2-65c2-4263-8a2b-5cec01e75c50","Type":"ContainerDied","Data":"0b5e9fedb6a33561ec5062de3593affb7d953f354897642921651a0038638515"}
Sep 18 17:19:13.738276 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.738251    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:19:13.811092 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.811066    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq46g\" (UniqueName: \"kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g\") pod \"25992ac2-65c2-4263-8a2b-5cec01e75c50\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") "
Sep 18 17:19:13.811227 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.811117    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util\") pod \"25992ac2-65c2-4263-8a2b-5cec01e75c50\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") "
Sep 18 17:19:13.811227 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.811140    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle\") pod \"25992ac2-65c2-4263-8a2b-5cec01e75c50\" (UID: \"25992ac2-65c2-4263-8a2b-5cec01e75c50\") "
Sep 18 17:19:13.811773 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.811753    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle" (OuterVolumeSpecName: "bundle") pod "25992ac2-65c2-4263-8a2b-5cec01e75c50" (UID: "25992ac2-65c2-4263-8a2b-5cec01e75c50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:19:13.813398 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.813374    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g" (OuterVolumeSpecName: "kube-api-access-rq46g") pod "25992ac2-65c2-4263-8a2b-5cec01e75c50" (UID: "25992ac2-65c2-4263-8a2b-5cec01e75c50"). InnerVolumeSpecName "kube-api-access-rq46g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:19:13.815059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.815033    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util" (OuterVolumeSpecName: "util") pod "25992ac2-65c2-4263-8a2b-5cec01e75c50" (UID: "25992ac2-65c2-4263-8a2b-5cec01e75c50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:19:13.912505 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.912454    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq46g\" (UniqueName: \"kubernetes.io/projected/25992ac2-65c2-4263-8a2b-5cec01e75c50-kube-api-access-rq46g\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:13.912505 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.912475    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:13.912505 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:13.912484    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/25992ac2-65c2-4263-8a2b-5cec01e75c50-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:14.606924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:14.606896    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll" event={"ID":"25992ac2-65c2-4263-8a2b-5cec01e75c50","Type":"ContainerDied","Data":"b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f"}
Sep 18 17:19:14.606924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:14.606925    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wptll"
Sep 18 17:19:14.607083 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:14.606939    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b56b3b2154fa60220d0ced5ae7fc4bad921e0a9ee05a774329eedf250cd5251f"
Sep 18 17:19:20.293343 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293298    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"]
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293561    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="util"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293575    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="util"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293583    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="pull"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293589    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="pull"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293597    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="extract"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="extract"
Sep 18 17:19:20.293747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.293653    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="25992ac2-65c2-4263-8a2b-5cec01e75c50" containerName="extract"
Sep 18 17:19:20.345320 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.345292    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"]
Sep 18 17:19:20.345459 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.345377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.348309 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.348284    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 18 17:19:20.349064 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.349044    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 18 17:19:20.349166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.349136    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nvnnp\""
Sep 18 17:19:20.455173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.455152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcc5s\" (UniqueName: \"kubernetes.io/projected/055788bb-4104-452a-b127-c4954c08ad69-kube-api-access-jcc5s\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.455279 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.455189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/055788bb-4104-452a-b127-c4954c08ad69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.555492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.555426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcc5s\" (UniqueName: \"kubernetes.io/projected/055788bb-4104-452a-b127-c4954c08ad69-kube-api-access-jcc5s\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.555492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.555466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/055788bb-4104-452a-b127-c4954c08ad69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.555786 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.555769    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/055788bb-4104-452a-b127-c4954c08ad69-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.565338 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.565309    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcc5s\" (UniqueName: \"kubernetes.io/projected/055788bb-4104-452a-b127-c4954c08ad69-kube-api-access-jcc5s\") pod \"cert-manager-operator-controller-manager-55c444bf86-9hvng\" (UID: \"055788bb-4104-452a-b127-c4954c08ad69\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.653949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.653928    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"
Sep 18 17:19:20.956968 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:20.956945    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng"]
Sep 18 17:19:20.959793 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:19:20.959758    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod055788bb_4104_452a_b127_c4954c08ad69.slice/crio-83a7b8596ca18f83e7b5b8186305f51db3648b19e96f6bb82765293a36a999c1 WatchSource:0}: Error finding container 83a7b8596ca18f83e7b5b8186305f51db3648b19e96f6bb82765293a36a999c1: Status 404 returned error can't find the container with id 83a7b8596ca18f83e7b5b8186305f51db3648b19e96f6bb82765293a36a999c1
Sep 18 17:19:21.633074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:21.633043    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng" event={"ID":"055788bb-4104-452a-b127-c4954c08ad69","Type":"ContainerStarted","Data":"83a7b8596ca18f83e7b5b8186305f51db3648b19e96f6bb82765293a36a999c1"}
Sep 18 17:19:23.642396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:23.642356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng" event={"ID":"055788bb-4104-452a-b127-c4954c08ad69","Type":"ContainerStarted","Data":"13fb9475c8d3c4b2212fde732ae588f24c4fc4c963fdbfb760d3600d07a03199"}
Sep 18 17:19:23.669395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:23.669322    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-9hvng" podStartSLOduration=1.364640909 podStartE2EDuration="3.669303517s" totalImagesPullingTime="2.304662608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:23.669008603 +0000 UTC m=+295.611266213" watchObservedRunningTime="2026-09-18 17:19:23.669303517 +0000 UTC m=+295.611561127"
Sep 18 17:19:28.428233 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:28.428200    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:19:28.439366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:28.439337    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 17:19:28.439823 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:28.439805    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:19:31.280349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.280313    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"]
Sep 18 17:19:31.282393 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.282373    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.285643 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.285605    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fgk5r\""
Sep 18 17:19:31.285792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.285711    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 17:19:31.286789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.286767    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 17:19:31.300041 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.300014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"]
Sep 18 17:19:31.326982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.326954    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcwbp\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-kube-api-access-xcwbp\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.327080 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.326985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.427563 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.427537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcwbp\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-kube-api-access-xcwbp\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.427676 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.427569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.440993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.440959    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcwbp\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-kube-api-access-xcwbp\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.441097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.441070    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04308973-f6ce-4ed3-bd22-02eddbad4853-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-ql4zn\" (UID: \"04308973-f6ce-4ed3-bd22-02eddbad4853\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.592893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.592829    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"
Sep 18 17:19:31.871345 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.871314    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn"]
Sep 18 17:19:31.874029 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:19:31.874002    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04308973_f6ce_4ed3_bd22_02eddbad4853.slice/crio-1d9efcda3562c4513e51d75e7ec6dc0bfea0c9556a7001125baa2153b4c09b98 WatchSource:0}: Error finding container 1d9efcda3562c4513e51d75e7ec6dc0bfea0c9556a7001125baa2153b4c09b98: Status 404 returned error can't find the container with id 1d9efcda3562c4513e51d75e7ec6dc0bfea0c9556a7001125baa2153b4c09b98
Sep 18 17:19:31.876179 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:31.876162    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:19:32.676690 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:32.676655    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn" event={"ID":"04308973-f6ce-4ed3-bd22-02eddbad4853","Type":"ContainerStarted","Data":"1d9efcda3562c4513e51d75e7ec6dc0bfea0c9556a7001125baa2153b4c09b98"}
Sep 18 17:19:34.686623 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:34.686592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn" event={"ID":"04308973-f6ce-4ed3-bd22-02eddbad4853","Type":"ContainerStarted","Data":"79e95eb699743058b0e3b1460519ab17472b84e015f22fc08ee89bf2e42ca150"}
Sep 18 17:19:34.705379 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:34.705333    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-ql4zn" podStartSLOduration=1.233184729 podStartE2EDuration="3.705318636s" totalImagesPullingTime="2.472133907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:34.704258502 +0000 UTC m=+306.646516110" watchObservedRunningTime="2026-09-18 17:19:34.705318636 +0000 UTC m=+306.647576245"
Sep 18 17:19:36.872530 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.872485    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p722"]
Sep 18 17:19:36.874622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.874598    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:36.880124 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.880069    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-98r7x\""
Sep 18 17:19:36.902202 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.902172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p722"]
Sep 18 17:19:36.966298 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.966276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:36.966443 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:36.966309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7tn\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-kube-api-access-nr7tn\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.067023 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.066996    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7tn\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-kube-api-access-nr7tn\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.067160 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.067047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.076314 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.076294    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.076573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.076547    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7tn\" (UniqueName: \"kubernetes.io/projected/f1e9e225-bbd4-4cce-8938-f4eaba8dcecd-kube-api-access-nr7tn\") pod \"cert-manager-webhook-6486ffd997-5p722\" (UID: \"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.184607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.184558    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.454860 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.454794    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-5p722"]
Sep 18 17:19:37.458561 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:19:37.458528    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1e9e225_bbd4_4cce_8938_f4eaba8dcecd.slice/crio-f628ab9cf1a741f2a9d8f6a57e738fccd3c9c83f5bc4adc6ee79646b9327753a WatchSource:0}: Error finding container f628ab9cf1a741f2a9d8f6a57e738fccd3c9c83f5bc4adc6ee79646b9327753a: Status 404 returned error can't find the container with id f628ab9cf1a741f2a9d8f6a57e738fccd3c9c83f5bc4adc6ee79646b9327753a
Sep 18 17:19:37.699190 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.699148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722" event={"ID":"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd","Type":"ContainerStarted","Data":"7b21d5060b9b3795b7afa152ffaacfe7ce5245b827692b205bb8949227d4e585"}
Sep 18 17:19:37.699356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.699196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722" event={"ID":"f1e9e225-bbd4-4cce-8938-f4eaba8dcecd","Type":"ContainerStarted","Data":"f628ab9cf1a741f2a9d8f6a57e738fccd3c9c83f5bc4adc6ee79646b9327753a"}
Sep 18 17:19:37.699356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.699229    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:37.722126 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:37.722030    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722" podStartSLOduration=1.722016081 podStartE2EDuration="1.722016081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:19:37.720149645 +0000 UTC m=+309.662407251" watchObservedRunningTime="2026-09-18 17:19:37.722016081 +0000 UTC m=+309.664273690"
Sep 18 17:19:43.705647 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:43.705609    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-5p722"
Sep 18 17:19:51.100123 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.100065    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"]
Sep 18 17:19:51.102401 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.102379    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.106096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.106065    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 17:19:51.106262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.106065    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ft7jf\""
Sep 18 17:19:51.107051 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.107032    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 17:19:51.114822 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.114788    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"]
Sep 18 17:19:51.162562 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.162530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khpc\" (UniqueName: \"kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.162686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.162631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.162686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.162662    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.263286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.263259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.263396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.263289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.263396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.263311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khpc\" (UniqueName: \"kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.263664 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.263645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.263730 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.263674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.271801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.271780    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khpc\" (UniqueName: \"kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.412395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.412332    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:51.693601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.693573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"]
Sep 18 17:19:51.695943 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:19:51.695913    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8db781b7_7fa9_419e_8c19_e8d223a1c6c5.slice/crio-5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0 WatchSource:0}: Error finding container 5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0: Status 404 returned error can't find the container with id 5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0
Sep 18 17:19:51.754284 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.754256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerStarted","Data":"fe871226ef70a4123812707666bb5f680b4f2dbbb803f291f52e5935584eaf31"}
Sep 18 17:19:51.754440 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:51.754315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerStarted","Data":"5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0"}
Sep 18 17:19:52.761232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:52.761192    2584 generic.go:356] "Generic (PLEG): container finished" podID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerID="fe871226ef70a4123812707666bb5f680b4f2dbbb803f291f52e5935584eaf31" exitCode=0
Sep 18 17:19:52.761596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:52.761276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerDied","Data":"fe871226ef70a4123812707666bb5f680b4f2dbbb803f291f52e5935584eaf31"}
Sep 18 17:19:53.767501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:53.767438    2584 generic.go:356] "Generic (PLEG): container finished" podID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerID="3af47a585cb94e66e80ec1a48a5f4dd81a7593ba43f38df0f6bb1b5c748adf4c" exitCode=0
Sep 18 17:19:53.767501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:53.767489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerDied","Data":"3af47a585cb94e66e80ec1a48a5f4dd81a7593ba43f38df0f6bb1b5c748adf4c"}
Sep 18 17:19:54.773835 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:54.773796    2584 generic.go:356] "Generic (PLEG): container finished" podID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerID="c566a935eeebd3feacb72c8c6d1accf4d8e31e58087d7e9910ef57189aabad41" exitCode=0
Sep 18 17:19:54.774288 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:54.773843    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerDied","Data":"c566a935eeebd3feacb72c8c6d1accf4d8e31e58087d7e9910ef57189aabad41"}
Sep 18 17:19:55.904398 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.904370    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:55.995501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.995479    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7khpc\" (UniqueName: \"kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc\") pod \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") "
Sep 18 17:19:55.995630 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.995519    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util\") pod \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") "
Sep 18 17:19:55.995630 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.995571    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle\") pod \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\" (UID: \"8db781b7-7fa9-419e-8c19-e8d223a1c6c5\") "
Sep 18 17:19:55.996276 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.996243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle" (OuterVolumeSpecName: "bundle") pod "8db781b7-7fa9-419e-8c19-e8d223a1c6c5" (UID: "8db781b7-7fa9-419e-8c19-e8d223a1c6c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:19:55.997655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:55.997622    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc" (OuterVolumeSpecName: "kube-api-access-7khpc") pod "8db781b7-7fa9-419e-8c19-e8d223a1c6c5" (UID: "8db781b7-7fa9-419e-8c19-e8d223a1c6c5"). InnerVolumeSpecName "kube-api-access-7khpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:19:56.001577 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.001545    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util" (OuterVolumeSpecName: "util") pod "8db781b7-7fa9-419e-8c19-e8d223a1c6c5" (UID: "8db781b7-7fa9-419e-8c19-e8d223a1c6c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:19:56.096589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.096531    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7khpc\" (UniqueName: \"kubernetes.io/projected/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-kube-api-access-7khpc\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:56.096589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.096562    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:56.096589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.096572    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8db781b7-7fa9-419e-8c19-e8d223a1c6c5-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:19:56.785174 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.785140    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx" event={"ID":"8db781b7-7fa9-419e-8c19-e8d223a1c6c5","Type":"ContainerDied","Data":"5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0"}
Sep 18 17:19:56.785174 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.785160    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjjlvx"
Sep 18 17:19:56.785329 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:19:56.785185    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5dbb2d31423aa4a779488204a0d790c0a5cdc4e8086b8d3e35859f947505dde0"
Sep 18 17:20:08.536232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536194    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"]
Sep 18 17:20:08.536777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536754    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="util"
Sep 18 17:20:08.536850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536781    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="util"
Sep 18 17:20:08.536850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536793    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="extract"
Sep 18 17:20:08.536850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536801    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="extract"
Sep 18 17:20:08.536850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536821    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="pull"
Sep 18 17:20:08.536850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536829    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="pull"
Sep 18 17:20:08.537070 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.536962    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8db781b7-7fa9-419e-8c19-e8d223a1c6c5" containerName="extract"
Sep 18 17:20:08.540517 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.540497    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.543743 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.543719    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 17:20:08.543847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.543829    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 17:20:08.543924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.543867    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlwd7\""
Sep 18 17:20:08.543924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.543893    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 17:20:08.544607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.544587    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 17:20:08.559665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.559641    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"]
Sep 18 17:20:08.677759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.677737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xc9n\" (UniqueName: \"kubernetes.io/projected/800632a6-1776-4a22-9219-1c4b39447041-kube-api-access-4xc9n\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.677855 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.677769    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-webhook-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.677855 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.677805    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-tmp\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.677855 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.677847    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.677976 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.677872    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-manifests\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.778698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.778672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-manifests\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.778825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.778702    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xc9n\" (UniqueName: \"kubernetes.io/projected/800632a6-1776-4a22-9219-1c4b39447041-kube-api-access-4xc9n\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.778825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.778724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-webhook-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.778825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.778757    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-tmp\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.778825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.778775    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.779157 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.779136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-manifests\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.781378 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.781355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/800632a6-1776-4a22-9219-1c4b39447041-tmp\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.781461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.781390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-webhook-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.781501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.781472    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/800632a6-1776-4a22-9219-1c4b39447041-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.788292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.788241    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xc9n\" (UniqueName: \"kubernetes.io/projected/800632a6-1776-4a22-9219-1c4b39447041-kube-api-access-4xc9n\") pod \"opendatahub-operator-controller-manager-9496889b9-7j846\" (UID: \"800632a6-1776-4a22-9219-1c4b39447041\") " pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:08.852899 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:08.852873    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:09.131696 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:09.131580    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"]
Sep 18 17:20:09.134247 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:09.134220    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800632a6_1776_4a22_9219_1c4b39447041.slice/crio-c95eb126c0f0d7f8f57e2a85e3aae17cfb63a1192b00d6d1e40ea0942037183a WatchSource:0}: Error finding container c95eb126c0f0d7f8f57e2a85e3aae17cfb63a1192b00d6d1e40ea0942037183a: Status 404 returned error can't find the container with id c95eb126c0f0d7f8f57e2a85e3aae17cfb63a1192b00d6d1e40ea0942037183a
Sep 18 17:20:09.838736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:09.838705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846" event={"ID":"800632a6-1776-4a22-9219-1c4b39447041","Type":"ContainerStarted","Data":"c95eb126c0f0d7f8f57e2a85e3aae17cfb63a1192b00d6d1e40ea0942037183a"}
Sep 18 17:20:12.853776 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:12.853738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846" event={"ID":"800632a6-1776-4a22-9219-1c4b39447041","Type":"ContainerStarted","Data":"2a827169f858bc5d2b32cc88837fd810e79c7c64c639eda3d8c733a4af3a6006"}
Sep 18 17:20:13.859479 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:13.859447    2584 generic.go:356] "Generic (PLEG): container finished" podID="800632a6-1776-4a22-9219-1c4b39447041" containerID="2a827169f858bc5d2b32cc88837fd810e79c7c64c639eda3d8c733a4af3a6006" exitCode=0
Sep 18 17:20:13.859923 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:13.859543    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846" event={"ID":"800632a6-1776-4a22-9219-1c4b39447041","Type":"ContainerDied","Data":"2a827169f858bc5d2b32cc88837fd810e79c7c64c639eda3d8c733a4af3a6006"}
Sep 18 17:20:14.866793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:14.866756    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846" event={"ID":"800632a6-1776-4a22-9219-1c4b39447041","Type":"ContainerStarted","Data":"ac8af51c3c9950b04b50c15b6720e3f1e192b971acb81be74999e673d118330b"}
Sep 18 17:20:14.867231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:14.866896    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:14.899332 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:14.899282    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846" podStartSLOduration=2.473922033 podStartE2EDuration="6.89926528s" totalImagesPullingTime="3.366880322s" totalInitContainerRuntime="1.058462925s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:14.896976375 +0000 UTC m=+346.839233985" watchObservedRunningTime="2026-09-18 17:20:14.89926528 +0000 UTC m=+346.841522891"
Sep 18 17:20:25.873003 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:25.872971    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9496889b9-7j846"
Sep 18 17:20:29.478999 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.478969    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"]
Sep 18 17:20:29.483785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.483765    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.486834 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.486816    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 18 17:20:29.487072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.487056    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bx9gx\""
Sep 18 17:20:29.488059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.488043    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 17:20:29.488213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.488200    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 17:20:29.488316 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.488302    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 18 17:20:29.496690 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.496669    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"]
Sep 18 17:20:29.617795 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.617776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pcgg\" (UniqueName: \"kubernetes.io/projected/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-kube-api-access-9pcgg\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.617900 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.617814    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tls-certs\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.617900 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.617835    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tmp\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.718250 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.718226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pcgg\" (UniqueName: \"kubernetes.io/projected/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-kube-api-access-9pcgg\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.718341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.718261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tls-certs\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.718341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.718277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tmp\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.720718 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.720692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tmp\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.721087 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.721072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-tls-certs\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.731186 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.731138    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pcgg\" (UniqueName: \"kubernetes.io/projected/43faafad-12eb-4d3b-99d9-0a7e6aed62b2-kube-api-access-9pcgg\") pod \"kube-auth-proxy-65b7cd5988-rcw5z\" (UID: \"43faafad-12eb-4d3b-99d9-0a7e6aed62b2\") " pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:29.793140 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:29.793100    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"
Sep 18 17:20:30.080909 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:30.080882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z"]
Sep 18 17:20:30.083227 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:30.083202    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43faafad_12eb_4d3b_99d9_0a7e6aed62b2.slice/crio-5974ba3077f61c0d7e0de9a3b9afeb3d61073a4600a52d66cbb396ad3c033226 WatchSource:0}: Error finding container 5974ba3077f61c0d7e0de9a3b9afeb3d61073a4600a52d66cbb396ad3c033226: Status 404 returned error can't find the container with id 5974ba3077f61c0d7e0de9a3b9afeb3d61073a4600a52d66cbb396ad3c033226
Sep 18 17:20:30.937381 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:30.937327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z" event={"ID":"43faafad-12eb-4d3b-99d9-0a7e6aed62b2","Type":"ContainerStarted","Data":"5974ba3077f61c0d7e0de9a3b9afeb3d61073a4600a52d66cbb396ad3c033226"}
Sep 18 17:20:33.951261 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:33.951225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z" event={"ID":"43faafad-12eb-4d3b-99d9-0a7e6aed62b2","Type":"ContainerStarted","Data":"2cb13ac22b08fbb6850813cbc44042a07e53d20da05d4fe02c0bda7d2bb55420"}
Sep 18 17:20:33.977075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:33.977024    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65b7cd5988-rcw5z" podStartSLOduration=2.139873767 podStartE2EDuration="4.977010851s" totalImagesPullingTime="2.837137084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:33.975906648 +0000 UTC m=+365.918164256" watchObservedRunningTime="2026-09-18 17:20:33.977010851 +0000 UTC m=+365.919268484"
Sep 18 17:20:36.914270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:36.914233    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:36.917587 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:36.917564    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:36.920941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:36.920917    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 17:20:36.920941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:36.920935    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z4tlw\""
Sep 18 17:20:36.934196 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:36.934177    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:37.071722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071686    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071770    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071847    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwch\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071888    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.071934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.071921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.172980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwch\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173178    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173196    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173534 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173534 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173534 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173456    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.173979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.174040 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.173972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.174401 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.174379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.175726 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.175700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.176181 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.176162    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.182824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.182796    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.183986 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.183962    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwch\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.228169 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.228140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:37.516862 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.516836    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:37.518850 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:37.518826    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1409f6ab_cf52_48b8_846d_e646fbdcd9c2.slice/crio-1157d189c0439234871bacfd6d53ae8c0bd5cfce92cae85947b7dd97c27abb1a WatchSource:0}: Error finding container 1157d189c0439234871bacfd6d53ae8c0bd5cfce92cae85947b7dd97c27abb1a: Status 404 returned error can't find the container with id 1157d189c0439234871bacfd6d53ae8c0bd5cfce92cae85947b7dd97c27abb1a
Sep 18 17:20:37.969264 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:37.969226    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" event={"ID":"1409f6ab-cf52-48b8-846d-e646fbdcd9c2","Type":"ContainerStarted","Data":"1157d189c0439234871bacfd6d53ae8c0bd5cfce92cae85947b7dd97c27abb1a"}
Sep 18 17:20:39.941100 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:39.941062    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92wv"]
Sep 18 17:20:39.947993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:39.947974    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:39.951595 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:39.951518    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 18 17:20:39.953203 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:39.953182    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92wv"]
Sep 18 17:20:39.953648 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:39.953610    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lvc66\""
Sep 18 17:20:40.099729 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.099695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcx7v\" (UniqueName: \"kubernetes.io/projected/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-kube-api-access-mcx7v\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.099906 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.099744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.201173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.201069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcx7v\" (UniqueName: \"kubernetes.io/projected/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-kube-api-access-mcx7v\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.201173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.201133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.201378 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:20:40.201292    2584 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 18 17:20:40.201378 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:20:40.201357    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert podName:34ea59d6-1fd9-402b-b72f-bf8f7f83fa61 nodeName:}" failed. No retries permitted until 2026-09-18 17:20:40.70133841 +0000 UTC m=+372.643595997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert") pod "odh-model-controller-7998c67dc4-m92wv" (UID: "34ea59d6-1fd9-402b-b72f-bf8f7f83fa61") : secret "odh-model-controller-webhook-cert" not found
Sep 18 17:20:40.215245 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.215208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcx7v\" (UniqueName: \"kubernetes.io/projected/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-kube-api-access-mcx7v\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.390511 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.390464    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:20:40.390627 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.390547    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:20:40.390627 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.390606    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:20:40.632698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.632666    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hqczm"]
Sep 18 17:20:40.635756 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.635731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.638496 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.638476    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 18 17:20:40.638616 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.638514    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gm8sd\""
Sep 18 17:20:40.648805 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.648781    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hqczm"]
Sep 18 17:20:40.706623 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.706542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.709034 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.709012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/34ea59d6-1fd9-402b-b72f-bf8f7f83fa61-cert\") pod \"odh-model-controller-7998c67dc4-m92wv\" (UID: \"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61\") " pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.806930 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.806893    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347bd51b-88ca-4434-ab79-875850d7c1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.807084 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.806945    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkst\" (UniqueName: \"kubernetes.io/projected/347bd51b-88ca-4434-ab79-875850d7c1f9-kube-api-access-wvkst\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.862279 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.862252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:40.908371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.907574    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347bd51b-88ca-4434-ab79-875850d7c1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.908371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.907656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkst\" (UniqueName: \"kubernetes.io/projected/347bd51b-88ca-4434-ab79-875850d7c1f9-kube-api-access-wvkst\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.911760 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.911532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347bd51b-88ca-4434-ab79-875850d7c1f9-tls-certs\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.917357 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.917332    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkst\" (UniqueName: \"kubernetes.io/projected/347bd51b-88ca-4434-ab79-875850d7c1f9-kube-api-access-wvkst\") pod \"model-serving-api-54d89bd5fc-hqczm\" (UID: \"347bd51b-88ca-4434-ab79-875850d7c1f9\") " pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.948965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.948939    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:40.985902 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:40.985863    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" event={"ID":"1409f6ab-cf52-48b8-846d-e646fbdcd9c2","Type":"ContainerStarted","Data":"c49e2b76d852a27eba1038c873af2f70e259649142789386bce15e3509837501"}
Sep 18 17:20:41.008390 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.008347    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" podStartSLOduration=2.139160655 podStartE2EDuration="5.00832452s" totalImagesPullingTime="2.869163865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:41.006208786 +0000 UTC m=+372.948466429" watchObservedRunningTime="2026-09-18 17:20:41.00832452 +0000 UTC m=+372.950582131"
Sep 18 17:20:41.136953 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.136928    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m92wv"]
Sep 18 17:20:41.138268 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:41.138239    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ea59d6_1fd9_402b_b72f_bf8f7f83fa61.slice/crio-8de5aa12f48d0c8e8b038e1eaed502b618ca9336d2f2fd32e221071d4f77197b WatchSource:0}: Error finding container 8de5aa12f48d0c8e8b038e1eaed502b618ca9336d2f2fd32e221071d4f77197b: Status 404 returned error can't find the container with id 8de5aa12f48d0c8e8b038e1eaed502b618ca9336d2f2fd32e221071d4f77197b
Sep 18 17:20:41.223135 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.223044    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-hqczm"]
Sep 18 17:20:41.226721 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:41.226698    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347bd51b_88ca_4434_ab79_875850d7c1f9.slice/crio-3ee91d9a11bc8ecb67e5420210073908c3fe40ffec279395e40895f0a7df44f1 WatchSource:0}: Error finding container 3ee91d9a11bc8ecb67e5420210073908c3fe40ffec279395e40895f0a7df44f1: Status 404 returned error can't find the container with id 3ee91d9a11bc8ecb67e5420210073908c3fe40ffec279395e40895f0a7df44f1
Sep 18 17:20:41.228494 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.228472    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:41.229925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.229902    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body=
Sep 18 17:20:41.230028 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.229942    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused"
Sep 18 17:20:41.996050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.995962    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv" event={"ID":"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61","Type":"ContainerStarted","Data":"8de5aa12f48d0c8e8b038e1eaed502b618ca9336d2f2fd32e221071d4f77197b"}
Sep 18 17:20:41.998168 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:41.998087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm" event={"ID":"347bd51b-88ca-4434-ab79-875850d7c1f9","Type":"ContainerStarted","Data":"3ee91d9a11bc8ecb67e5420210073908c3fe40ffec279395e40895f0a7df44f1"}
Sep 18 17:20:42.229755 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:42.229558    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body=
Sep 18 17:20:42.229755 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:42.229627    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused"
Sep 18 17:20:43.228555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:43.228515    2584 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body=
Sep 18 17:20:43.229022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:43.228582    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused"
Sep 18 17:20:43.617464 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:43.617430    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:44.008249 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:44.008151    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy" containerID="cri-o://c49e2b76d852a27eba1038c873af2f70e259649142789386bce15e3509837501" gracePeriod=30
Sep 18 17:20:45.014185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.014139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv" event={"ID":"34ea59d6-1fd9-402b-b72f-bf8f7f83fa61","Type":"ContainerStarted","Data":"2b56f2c56ad2302f6558807176ddefdff873e112fedd980fee6c9e578238f658"}
Sep 18 17:20:45.014602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.014216    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:20:45.015734 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.015710    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm" event={"ID":"347bd51b-88ca-4434-ab79-875850d7c1f9","Type":"ContainerStarted","Data":"966b461b76d926123b19a5a67c6d3b4970dbdcb4c2ebf444baa0e798d6bfabd4"}
Sep 18 17:20:45.015860 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.015841    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:45.034643 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.034603    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv" podStartSLOduration=2.770835357 podStartE2EDuration="6.034590077s" totalImagesPullingTime="3.26375472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:45.033738871 +0000 UTC m=+376.975996481" watchObservedRunningTime="2026-09-18 17:20:45.034590077 +0000 UTC m=+376.976847686"
Sep 18 17:20:45.054564 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:45.054503    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm" podStartSLOduration=1.942000795 podStartE2EDuration="5.054489284s" totalImagesPullingTime="3.112488489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:45.053304945 +0000 UTC m=+376.995562567" watchObservedRunningTime="2026-09-18 17:20:45.054489284 +0000 UTC m=+376.996746893"
Sep 18 17:20:47.054614 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.054567    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"]
Sep 18 17:20:47.059225 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.059202    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.064477 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.064458    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 17:20:47.064601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.064582    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7z85n\""
Sep 18 17:20:47.065040 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.065026    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 17:20:47.065159 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.065147    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 17:20:47.080190 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.080168    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"]
Sep 18 17:20:47.158611 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158582    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/156ac9cd-3b85-4041-bbc8-083d9b413b04-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fg6m\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-kube-api-access-5fg6m\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158727    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158892 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158756    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.158892 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.158796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259628 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259628 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259802 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259648    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259835 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259904 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259889    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/156ac9cd-3b85-4041-bbc8-083d9b413b04-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.259944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259927    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.260003 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.259964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fg6m\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-kube-api-access-5fg6m\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.260809 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.260751    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.262404 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.262378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.262638 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.262616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.262768 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.262745    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/156ac9cd-3b85-4041-bbc8-083d9b413b04-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.262812 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.262772    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/156ac9cd-3b85-4041-bbc8-083d9b413b04-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.279416 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.279394    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.280302 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.280282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fg6m\" (UniqueName: \"kubernetes.io/projected/156ac9cd-3b85-4041-bbc8-083d9b413b04-kube-api-access-5fg6m\") pod \"istiod-openshift-gateway-5677ccb49b-jx694\" (UID: \"156ac9cd-3b85-4041-bbc8-083d9b413b04\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.368272 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.368230    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:47.702941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:47.702912    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"]
Sep 18 17:20:47.704280 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:20:47.704258    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod156ac9cd_3b85_4041_bbc8_083d9b413b04.slice/crio-7584272f6c7f71efdaaaafce85addd9ae49d1eead5c27dddab368d094984bc23 WatchSource:0}: Error finding container 7584272f6c7f71efdaaaafce85addd9ae49d1eead5c27dddab368d094984bc23: Status 404 returned error can't find the container with id 7584272f6c7f71efdaaaafce85addd9ae49d1eead5c27dddab368d094984bc23
Sep 18 17:20:48.029499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:48.029417    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694" event={"ID":"156ac9cd-3b85-4041-bbc8-083d9b413b04","Type":"ContainerStarted","Data":"7584272f6c7f71efdaaaafce85addd9ae49d1eead5c27dddab368d094984bc23"}
Sep 18 17:20:50.043304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.043263    2584 generic.go:356] "Generic (PLEG): container finished" podID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerID="c49e2b76d852a27eba1038c873af2f70e259649142789386bce15e3509837501" exitCode=0
Sep 18 17:20:50.043726 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.043331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" event={"ID":"1409f6ab-cf52-48b8-846d-e646fbdcd9c2","Type":"ContainerDied","Data":"c49e2b76d852a27eba1038c873af2f70e259649142789386bce15e3509837501"}
Sep 18 17:20:50.102543 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.102523    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:50.128648 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.128618    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:20:50.128732 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.128676    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:20:50.284904 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.284861    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.284910    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.284944    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.284976    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285009    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285072    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhwch\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285131    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285200    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285243    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data\") pod \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\" (UID: \"1409f6ab-cf52-48b8-846d-e646fbdcd9c2\") "
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285276    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285292    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:20:50.285353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285305    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:20:50.285640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285439    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:20:50.285640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285455    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istiod-ca-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.285640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285471    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.285640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285485    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-credential-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.285640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.285508    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:20:50.287730 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.287705    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:20:50.287864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.287811    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:20:50.287931 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.287883    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 17:20:50.287931 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.287910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch" (OuterVolumeSpecName: "kube-api-access-xhwch") pod "1409f6ab-cf52-48b8-846d-e646fbdcd9c2" (UID: "1409f6ab-cf52-48b8-846d-e646fbdcd9c2"). InnerVolumeSpecName "kube-api-access-xhwch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:20:50.386233 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386201    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-envoy\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.386233 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386235    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhwch\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-kube-api-access-xhwch\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.386419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386249    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-workload-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.386419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386263    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-token\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.386419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386275    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-data\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:50.386419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:50.386289    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1409f6ab-cf52-48b8-846d-e646fbdcd9c2-istio-podinfo\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:20:51.049700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.049667    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"
Sep 18 17:20:51.050213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.049673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt" event={"ID":"1409f6ab-cf52-48b8-846d-e646fbdcd9c2","Type":"ContainerDied","Data":"1157d189c0439234871bacfd6d53ae8c0bd5cfce92cae85947b7dd97c27abb1a"}
Sep 18 17:20:51.050213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.049841    2584 scope.go:117] "RemoveContainer" containerID="c49e2b76d852a27eba1038c873af2f70e259649142789386bce15e3509837501"
Sep 18 17:20:51.051929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.051897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694" event={"ID":"156ac9cd-3b85-4041-bbc8-083d9b413b04","Type":"ContainerStarted","Data":"a15f8ab758add93cb21072e1f2cb36363f723c8563d9e24a37ed0f882c871774"}
Sep 18 17:20:51.052165 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.052145    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:51.053791 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.053764    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-jx694 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 17:20:51.053899 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.053834    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694" podUID="156ac9cd-3b85-4041-bbc8-083d9b413b04" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:20:51.075688 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.075653    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:51.077883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:51.077864    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcjjdpt"]
Sep 18 17:20:52.058954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:52.058930    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694"
Sep 18 17:20:52.091287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:52.091239    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jx694" podStartSLOduration=2.669539953 podStartE2EDuration="5.091222529s" totalImagesPullingTime="2.421682576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:20:51.114953781 +0000 UTC m=+383.057211389" watchObservedRunningTime="2026-09-18 17:20:52.091222529 +0000 UTC m=+384.033480138"
Sep 18 17:20:52.556925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:52.556892    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" path="/var/lib/kubelet/pods/1409f6ab-cf52-48b8-846d-e646fbdcd9c2/volumes"
Sep 18 17:20:56.023845 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:56.023810    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-hqczm"
Sep 18 17:20:56.028989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:20:56.028965    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-m92wv"
Sep 18 17:21:46.900492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.900456    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"]
Sep 18 17:21:46.900968 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.900734    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy"
Sep 18 17:21:46.900968 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.900745    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy"
Sep 18 17:21:46.900968 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.900806    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1409f6ab-cf52-48b8-846d-e646fbdcd9c2" containerName="istio-proxy"
Sep 18 17:21:46.904925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.904903    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:46.907871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.907844    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 17:21:46.907871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.907863    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 17:21:46.908052 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.907891    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ft7jf\""
Sep 18 17:21:46.913645 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.913621    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"]
Sep 18 17:21:46.987366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.987340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:46.987485 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.987379    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n554d\" (UniqueName: \"kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:46.987485 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:46.987413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.001540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.001515    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"]
Sep 18 17:21:47.003701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.003687    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.021341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.021322    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"]
Sep 18 17:21:47.087838 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.087815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vfn\" (UniqueName: \"kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.087945 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.087855    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.088001 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.087983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n554d\" (UniqueName: \"kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.088047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.088033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.088083 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.088055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.088142 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.088089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.088184 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.088163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.088366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.088349    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.099407 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.099389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n554d\" (UniqueName: \"kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.131175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.131150    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"]
Sep 18 17:21:47.133373 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.133358    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.148700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.148681    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"]
Sep 18 17:21:47.189444 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.189444 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189442    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.189605 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.189605 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.189605 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnkwr\" (UniqueName: \"kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.189605 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vfn\" (UniqueName: \"kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.189845 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.189901 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.189832    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.200261 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.200233    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vfn\" (UniqueName: \"kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.214905 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.214888    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:47.241042 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.241021    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"]
Sep 18 17:21:47.244473 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.244458    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.264132 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.264046    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"]
Sep 18 17:21:47.290635 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.290604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.290770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.290654    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnkwr\" (UniqueName: \"kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.290770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.290679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.290770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.290704    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.291029 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.290728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdrvk\" (UniqueName: \"kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.291128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.291026    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.291400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.291321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.291630 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.291611    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.300401 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.300383    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnkwr\" (UniqueName: \"kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.311731 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.311710    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:47.392022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.391992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.392141 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.392029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.392141 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.392047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdrvk\" (UniqueName: \"kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.392471 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.392449    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.392523 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.392509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.401501 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.401483    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdrvk\" (UniqueName: \"kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.441839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.441788    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:47.504264 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.500623    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"]
Sep 18 17:21:47.506186 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:21:47.506157    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b00a6e3_9c29_4c24_8349_54888d349e42.slice/crio-ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3 WatchSource:0}: Error finding container ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3: Status 404 returned error can't find the container with id ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3
Sep 18 17:21:47.555205 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.555186    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:47.590801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.590684    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"]
Sep 18 17:21:47.592923 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:21:47.592875    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47daf9de_0ea7_4838_80b3_8e1511f16019.slice/crio-4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d WatchSource:0}: Error finding container 4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d: Status 404 returned error can't find the container with id 4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d
Sep 18 17:21:47.713893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.713868    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"]
Sep 18 17:21:47.715365 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:21:47.715338    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod910f3593_27d4_4cc8_8483_2c3969c91ddf.slice/crio-baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5 WatchSource:0}: Error finding container baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5: Status 404 returned error can't find the container with id baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5
Sep 18 17:21:47.845999 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:47.845973    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"]
Sep 18 17:21:47.894917 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:21:47.894888    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3bdca6_48a7_43b9_8fa9_43758974ca38.slice/crio-c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd WatchSource:0}: Error finding container c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd: Status 404 returned error can't find the container with id c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd
Sep 18 17:21:48.310834 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.310757    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerID="52b3f0ca4740741d15ea284e4df26a238e7b0d896981fa46690e1ba2c66f349f" exitCode=0
Sep 18 17:21:48.311214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.310839    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm" event={"ID":"1d3bdca6-48a7-43b9-8fa9-43758974ca38","Type":"ContainerDied","Data":"52b3f0ca4740741d15ea284e4df26a238e7b0d896981fa46690e1ba2c66f349f"}
Sep 18 17:21:48.311214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.310891    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm" event={"ID":"1d3bdca6-48a7-43b9-8fa9-43758974ca38","Type":"ContainerStarted","Data":"c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd"}
Sep 18 17:21:48.312660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.312634    2584 generic.go:356] "Generic (PLEG): container finished" podID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerID="7fa5dbb45bff694e445b2841c32278507fae3a17a55105c5c324b135dc8d9bdc" exitCode=0
Sep 18 17:21:48.312759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.312715    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerDied","Data":"7fa5dbb45bff694e445b2841c32278507fae3a17a55105c5c324b135dc8d9bdc"}
Sep 18 17:21:48.312825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.312766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerStarted","Data":"baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5"}
Sep 18 17:21:48.314471 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.314453    2584 generic.go:356] "Generic (PLEG): container finished" podID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerID="cd5eba04519ef6b8f1b0c77c71df27637ae46f59230e7db35878799e05bc69c9" exitCode=0
Sep 18 17:21:48.314578 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.314535    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24" event={"ID":"47daf9de-0ea7-4838-80b3-8e1511f16019","Type":"ContainerDied","Data":"cd5eba04519ef6b8f1b0c77c71df27637ae46f59230e7db35878799e05bc69c9"}
Sep 18 17:21:48.314638 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.314580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24" event={"ID":"47daf9de-0ea7-4838-80b3-8e1511f16019","Type":"ContainerStarted","Data":"4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d"}
Sep 18 17:21:48.316183 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.316164    2584 generic.go:356] "Generic (PLEG): container finished" podID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerID="f64fddd57f3da06829b2e8f2fdf83e713b45eb759783d34274d78c3c84870c42" exitCode=0
Sep 18 17:21:48.316183 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.316190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerDied","Data":"f64fddd57f3da06829b2e8f2fdf83e713b45eb759783d34274d78c3c84870c42"}
Sep 18 17:21:48.316315 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:48.316253    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerStarted","Data":"ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3"}
Sep 18 17:21:49.322762 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.322727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerStarted","Data":"490c05f630aca67e826e30397f177c5c7b711ce3b76a7fa40f1e12a14403a398"}
Sep 18 17:21:49.324794 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.324769    2584 generic.go:356] "Generic (PLEG): container finished" podID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerID="57d6c87af6d1a43db4f3e92220ae64baf881170dc0a67ad3df99fd59080549cb" exitCode=0
Sep 18 17:21:49.324897 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.324873    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24" event={"ID":"47daf9de-0ea7-4838-80b3-8e1511f16019","Type":"ContainerDied","Data":"57d6c87af6d1a43db4f3e92220ae64baf881170dc0a67ad3df99fd59080549cb"}
Sep 18 17:21:49.327489 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.327467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerStarted","Data":"031a117a8eb8c825346d91b485e11d05d714f97196512dafd05e4253232da72c"}
Sep 18 17:21:49.329396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.329373    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerID="785cd751b075a5e99668c92bb2cfc9b97eec2973a839edc087dc3dca27d141f9" exitCode=0
Sep 18 17:21:49.329470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:49.329421    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm" event={"ID":"1d3bdca6-48a7-43b9-8fa9-43758974ca38","Type":"ContainerDied","Data":"785cd751b075a5e99668c92bb2cfc9b97eec2973a839edc087dc3dca27d141f9"}
Sep 18 17:21:50.336185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.336154    2584 generic.go:356] "Generic (PLEG): container finished" podID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerID="87c6f3bf9cda90e299c6c48e7b6f2afc711d97043b25a23b382568ad16488be5" exitCode=0
Sep 18 17:21:50.336602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.336247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24" event={"ID":"47daf9de-0ea7-4838-80b3-8e1511f16019","Type":"ContainerDied","Data":"87c6f3bf9cda90e299c6c48e7b6f2afc711d97043b25a23b382568ad16488be5"}
Sep 18 17:21:50.338056 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.338030    2584 generic.go:356] "Generic (PLEG): container finished" podID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerID="031a117a8eb8c825346d91b485e11d05d714f97196512dafd05e4253232da72c" exitCode=0
Sep 18 17:21:50.338190 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.338134    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerDied","Data":"031a117a8eb8c825346d91b485e11d05d714f97196512dafd05e4253232da72c"}
Sep 18 17:21:50.340316 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.340289    2584 generic.go:356] "Generic (PLEG): container finished" podID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerID="b9b29cee8a439e70e01d97c90f30ab7732cc9c7c618b0bfb22fff463d24d0f2e" exitCode=0
Sep 18 17:21:50.340418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.340395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm" event={"ID":"1d3bdca6-48a7-43b9-8fa9-43758974ca38","Type":"ContainerDied","Data":"b9b29cee8a439e70e01d97c90f30ab7732cc9c7c618b0bfb22fff463d24d0f2e"}
Sep 18 17:21:50.342145 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.342127    2584 generic.go:356] "Generic (PLEG): container finished" podID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerID="490c05f630aca67e826e30397f177c5c7b711ce3b76a7fa40f1e12a14403a398" exitCode=0
Sep 18 17:21:50.342216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:50.342164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerDied","Data":"490c05f630aca67e826e30397f177c5c7b711ce3b76a7fa40f1e12a14403a398"}
Sep 18 17:21:51.348885 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.348855    2584 generic.go:356] "Generic (PLEG): container finished" podID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerID="1d4558bcc2d1bff3064a78b65a8d2fdd98bf269fb0f2d879d8c1646cf162b954" exitCode=0
Sep 18 17:21:51.349349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.348970    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerDied","Data":"1d4558bcc2d1bff3064a78b65a8d2fdd98bf269fb0f2d879d8c1646cf162b954"}
Sep 18 17:21:51.350997 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.350970    2584 generic.go:356] "Generic (PLEG): container finished" podID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerID="e42059d6406cec1fc86ea007441331437623faf55e8830d4170e2ffec76b638e" exitCode=0
Sep 18 17:21:51.351165 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.351007    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerDied","Data":"e42059d6406cec1fc86ea007441331437623faf55e8830d4170e2ffec76b638e"}
Sep 18 17:21:51.507644 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.507624    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:51.510351 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.510334    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:51.624528 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624446    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util\") pod \"47daf9de-0ea7-4838-80b3-8e1511f16019\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") "
Sep 18 17:21:51.624528 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624500    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49vfn\" (UniqueName: \"kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn\") pod \"47daf9de-0ea7-4838-80b3-8e1511f16019\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") "
Sep 18 17:21:51.624528 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624516    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle\") pod \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") "
Sep 18 17:21:51.624811 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624532    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util\") pod \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") "
Sep 18 17:21:51.624811 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624559    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdrvk\" (UniqueName: \"kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk\") pod \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\" (UID: \"1d3bdca6-48a7-43b9-8fa9-43758974ca38\") "
Sep 18 17:21:51.624811 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624587    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle\") pod \"47daf9de-0ea7-4838-80b3-8e1511f16019\" (UID: \"47daf9de-0ea7-4838-80b3-8e1511f16019\") "
Sep 18 17:21:51.624968 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.624939    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle" (OuterVolumeSpecName: "bundle") pod "1d3bdca6-48a7-43b9-8fa9-43758974ca38" (UID: "1d3bdca6-48a7-43b9-8fa9-43758974ca38"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:51.625443 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.625259    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle" (OuterVolumeSpecName: "bundle") pod "47daf9de-0ea7-4838-80b3-8e1511f16019" (UID: "47daf9de-0ea7-4838-80b3-8e1511f16019"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:51.626809 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.626782    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn" (OuterVolumeSpecName: "kube-api-access-49vfn") pod "47daf9de-0ea7-4838-80b3-8e1511f16019" (UID: "47daf9de-0ea7-4838-80b3-8e1511f16019"). InnerVolumeSpecName "kube-api-access-49vfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:21:51.626920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.626864    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk" (OuterVolumeSpecName: "kube-api-access-wdrvk") pod "1d3bdca6-48a7-43b9-8fa9-43758974ca38" (UID: "1d3bdca6-48a7-43b9-8fa9-43758974ca38"). InnerVolumeSpecName "kube-api-access-wdrvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:21:51.630593 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.630558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util" (OuterVolumeSpecName: "util") pod "1d3bdca6-48a7-43b9-8fa9-43758974ca38" (UID: "1d3bdca6-48a7-43b9-8fa9-43758974ca38"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:51.630875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.630820    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util" (OuterVolumeSpecName: "util") pod "47daf9de-0ea7-4838-80b3-8e1511f16019" (UID: "47daf9de-0ea7-4838-80b3-8e1511f16019"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:51.725997 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.725970    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49vfn\" (UniqueName: \"kubernetes.io/projected/47daf9de-0ea7-4838-80b3-8e1511f16019-kube-api-access-49vfn\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:51.725997 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.725994    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:51.726163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.726005    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d3bdca6-48a7-43b9-8fa9-43758974ca38-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:51.726163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.726013    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdrvk\" (UniqueName: \"kubernetes.io/projected/1d3bdca6-48a7-43b9-8fa9-43758974ca38-kube-api-access-wdrvk\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:51.726163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.726022    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:51.726163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:51.726030    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/47daf9de-0ea7-4838-80b3-8e1511f16019-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.357905 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.357877    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm"
Sep 18 17:21:52.357905 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.357897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6drwsm" event={"ID":"1d3bdca6-48a7-43b9-8fa9-43758974ca38","Type":"ContainerDied","Data":"c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd"}
Sep 18 17:21:52.358344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.357944    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5c78d01fbc45918dd8c1cb1ffd44944225ee10cc3521f31fbc0a380235812dd"
Sep 18 17:21:52.359922 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.359896    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24"
Sep 18 17:21:52.359922 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.359903    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c7tx24" event={"ID":"47daf9de-0ea7-4838-80b3-8e1511f16019","Type":"ContainerDied","Data":"4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d"}
Sep 18 17:21:52.360064 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.359942    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4797dd6737dd98e069f8627820268984a7885d0aafbea32653dc64f5733aee0d"
Sep 18 17:21:52.511637 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.511612    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:52.537014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.536992    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:52.634042 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.633976    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util\") pod \"9b00a6e3-9c29-4c24-8349-54888d349e42\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") "
Sep 18 17:21:52.634042 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634037    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n554d\" (UniqueName: \"kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d\") pod \"9b00a6e3-9c29-4c24-8349-54888d349e42\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") "
Sep 18 17:21:52.634253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle\") pod \"910f3593-27d4-4cc8-8483-2c3969c91ddf\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") "
Sep 18 17:21:52.634253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634093    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle\") pod \"9b00a6e3-9c29-4c24-8349-54888d349e42\" (UID: \"9b00a6e3-9c29-4c24-8349-54888d349e42\") "
Sep 18 17:21:52.634253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634151    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnkwr\" (UniqueName: \"kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr\") pod \"910f3593-27d4-4cc8-8483-2c3969c91ddf\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") "
Sep 18 17:21:52.634253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634198    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util\") pod \"910f3593-27d4-4cc8-8483-2c3969c91ddf\" (UID: \"910f3593-27d4-4cc8-8483-2c3969c91ddf\") "
Sep 18 17:21:52.634918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634892    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle" (OuterVolumeSpecName: "bundle") pod "910f3593-27d4-4cc8-8483-2c3969c91ddf" (UID: "910f3593-27d4-4cc8-8483-2c3969c91ddf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:52.634918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.634897    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle" (OuterVolumeSpecName: "bundle") pod "9b00a6e3-9c29-4c24-8349-54888d349e42" (UID: "9b00a6e3-9c29-4c24-8349-54888d349e42"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:52.636963 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.636939    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr" (OuterVolumeSpecName: "kube-api-access-xnkwr") pod "910f3593-27d4-4cc8-8483-2c3969c91ddf" (UID: "910f3593-27d4-4cc8-8483-2c3969c91ddf"). InnerVolumeSpecName "kube-api-access-xnkwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:21:52.636963 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.636946    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d" (OuterVolumeSpecName: "kube-api-access-n554d") pod "9b00a6e3-9c29-4c24-8349-54888d349e42" (UID: "9b00a6e3-9c29-4c24-8349-54888d349e42"). InnerVolumeSpecName "kube-api-access-n554d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:21:52.642978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.642952    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util" (OuterVolumeSpecName: "util") pod "9b00a6e3-9c29-4c24-8349-54888d349e42" (UID: "9b00a6e3-9c29-4c24-8349-54888d349e42"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:52.643358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.643337    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util" (OuterVolumeSpecName: "util") pod "910f3593-27d4-4cc8-8483-2c3969c91ddf" (UID: "910f3593-27d4-4cc8-8483-2c3969c91ddf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:21:52.734991 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.734969    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n554d\" (UniqueName: \"kubernetes.io/projected/9b00a6e3-9c29-4c24-8349-54888d349e42-kube-api-access-n554d\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.734991 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.734991    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.735096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.735001    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-bundle\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.735096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.735009    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnkwr\" (UniqueName: \"kubernetes.io/projected/910f3593-27d4-4cc8-8483-2c3969c91ddf-kube-api-access-xnkwr\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.735096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.735017    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/910f3593-27d4-4cc8-8483-2c3969c91ddf-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:52.735096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:52.735025    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b00a6e3-9c29-4c24-8349-54888d349e42-util\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:21:53.367728 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.367698    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s"
Sep 18 17:21:53.368161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.367757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847awvq9s" event={"ID":"910f3593-27d4-4cc8-8483-2c3969c91ddf","Type":"ContainerDied","Data":"baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5"}
Sep 18 17:21:53.368161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.367801    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baafbcffbd1fc7c5d44f84575c2c037859dc90ea2212e030b65591e90f0d0cb5"
Sep 18 17:21:53.369602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.369580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp" event={"ID":"9b00a6e3-9c29-4c24-8349-54888d349e42","Type":"ContainerDied","Data":"ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3"}
Sep 18 17:21:53.369701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.369604    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7xlrgp"
Sep 18 17:21:53.369701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:21:53.369614    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce877b5c0cd86fc0d6aef1f46646db0b69a2bbe8921b2e6ed2e0e5e509072eb3"
Sep 18 17:22:01.493401 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493329    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-72zvd"]
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493775    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493797    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493815    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="util"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493823    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="util"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493836    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="extract"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493843    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="extract"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493857    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493865    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493873    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493880    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493889    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="extract"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493897    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="extract"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493912    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="util"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493920    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="util"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493928    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="pull"
Sep 18 17:22:01.493940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493936    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="pull"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493944    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493969    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493982    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="util"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.493990    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="util"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494005    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="util"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494013    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="util"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494023    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494031    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494128    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="47daf9de-0ea7-4838-80b3-8e1511f16019" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494141    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d3bdca6-48a7-43b9-8fa9-43758974ca38" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494154    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b00a6e3-9c29-4c24-8349-54888d349e42" containerName="extract"
Sep 18 17:22:01.494706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.494165    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="910f3593-27d4-4cc8-8483-2c3969c91ddf" containerName="extract"
Sep 18 17:22:01.498553 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.498530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:01.501623 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.501600    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m2pm9\""
Sep 18 17:22:01.501741 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.501677    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 18 17:22:01.502573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.502556    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 18 17:22:01.514253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.514226    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-72zvd"]
Sep 18 17:22:01.606552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.606511    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgr8g\" (UniqueName: \"kubernetes.io/projected/cfd653f7-415e-4ae1-9400-65f68a37273b-kube-api-access-bgr8g\") pod \"authorino-operator-76b478bd78-72zvd\" (UID: \"cfd653f7-415e-4ae1-9400-65f68a37273b\") " pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:01.707623 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.707583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgr8g\" (UniqueName: \"kubernetes.io/projected/cfd653f7-415e-4ae1-9400-65f68a37273b-kube-api-access-bgr8g\") pod \"authorino-operator-76b478bd78-72zvd\" (UID: \"cfd653f7-415e-4ae1-9400-65f68a37273b\") " pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:01.730663 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.730636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgr8g\" (UniqueName: \"kubernetes.io/projected/cfd653f7-415e-4ae1-9400-65f68a37273b-kube-api-access-bgr8g\") pod \"authorino-operator-76b478bd78-72zvd\" (UID: \"cfd653f7-415e-4ae1-9400-65f68a37273b\") " pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:01.808937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:01.808841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:02.116697 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:02.112072    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-72zvd"]
Sep 18 17:22:02.415515 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:02.415420    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd" event={"ID":"cfd653f7-415e-4ae1-9400-65f68a37273b","Type":"ContainerStarted","Data":"cf989155d9b268d8c1533236e16ad529388edc50d176dfcae4a9cb42024ef64a"}
Sep 18 17:22:05.433296 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:05.433190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd" event={"ID":"cfd653f7-415e-4ae1-9400-65f68a37273b","Type":"ContainerStarted","Data":"54d180eee88d9eab728dae3a71718f9590fffd7d099ec4db97ce2b17d59a86dd"}
Sep 18 17:22:05.433685 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:05.433302    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:05.471227 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:05.471150    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd" podStartSLOduration=1.427173071 podStartE2EDuration="4.471132468s" totalImagesPullingTime="3.043959397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:22:05.470326315 +0000 UTC m=+457.412583925" watchObservedRunningTime="2026-09-18 17:22:05.471132468 +0000 UTC m=+457.413390074"
Sep 18 17:22:08.291976 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.291941    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"]
Sep 18 17:22:08.295273 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.295254    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.299847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.299828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v5c59\""
Sep 18 17:22:08.318315 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.318283    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"]
Sep 18 17:22:08.366206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.366162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.366389 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.366254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f689v\" (UniqueName: \"kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.467395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.467349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f689v\" (UniqueName: \"kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.467585 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.467426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.467901 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.467881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.486045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.486011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f689v\" (UniqueName: \"kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.605700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.605663    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:08.906018 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:08.905992    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"]
Sep 18 17:22:08.908193 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:22:08.908162    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351b1b52_c4e1_4491_a2f9_2d51f4a9bc22.slice/crio-e1124159eda686d4c19deb189272d3d6985123ab023aa14e2633cf4b2461761a WatchSource:0}: Error finding container e1124159eda686d4c19deb189272d3d6985123ab023aa14e2633cf4b2461761a: Status 404 returned error can't find the container with id e1124159eda686d4c19deb189272d3d6985123ab023aa14e2633cf4b2461761a
Sep 18 17:22:09.454836 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:09.454792    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9" event={"ID":"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22","Type":"ContainerStarted","Data":"e1124159eda686d4c19deb189272d3d6985123ab023aa14e2633cf4b2461761a"}
Sep 18 17:22:13.478215 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:13.478160    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9" event={"ID":"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22","Type":"ContainerStarted","Data":"24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329"}
Sep 18 17:22:13.478645 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:13.478323    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:13.506342 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:13.506276    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9" podStartSLOduration=1.922096799 podStartE2EDuration="5.506253204s" totalImagesPullingTime="3.584156405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:22:13.504456969 +0000 UTC m=+465.446714578" watchObservedRunningTime="2026-09-18 17:22:13.506253204 +0000 UTC m=+465.448510818"
Sep 18 17:22:16.441518 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:16.441487    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-72zvd"
Sep 18 17:22:24.486071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:24.486034    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:27.564619 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.564578    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"]
Sep 18 17:22:27.565046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.564783    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" containerName="manager" containerID="cri-o://24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329" gracePeriod=2
Sep 18 17:22:27.571760 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.571713    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"]
Sep 18 17:22:27.698074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.698032    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:27.698421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.698405    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" containerName="manager"
Sep 18 17:22:27.698421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.698422    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" containerName="manager"
Sep 18 17:22:27.698555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.698507    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" containerName="manager"
Sep 18 17:22:27.701661 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.701631    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.707300 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:22:27.707193    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" is forbidden: User \"system:node:ip-10-0-135-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-187.ec2.internal' and this object" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:27.725360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.725322    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4tvb\" (UniqueName: \"kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.725545 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.725438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.760005 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.759966    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:27.826756 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.826723    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.826936 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.826828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4tvb\" (UniqueName: \"kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.827243 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.827219    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.834421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.834391    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:27.838678 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:22:27.838647    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" is forbidden: User \"system:node:ip-10-0-135-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-187.ec2.internal' and this object" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:27.878358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.878325    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4tvb\" (UniqueName: \"kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqxzt\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:27.927461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.927423    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f689v\" (UniqueName: \"kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v\") pod \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") "
Sep 18 17:22:27.927645 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.927499    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume\") pod \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\" (UID: \"351b1b52-c4e1-4491-a2f9-2d51f4a9bc22\") "
Sep 18 17:22:27.928001 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.927973    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" (UID: "351b1b52-c4e1-4491-a2f9-2d51f4a9bc22"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:22:27.929887 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:27.929860    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v" (OuterVolumeSpecName: "kube-api-access-f689v") pod "351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" (UID: "351b1b52-c4e1-4491-a2f9-2d51f4a9bc22"). InnerVolumeSpecName "kube-api-access-f689v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:22:28.013549 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.013513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:28.028877 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.028849    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f689v\" (UniqueName: \"kubernetes.io/projected/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-kube-api-access-f689v\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:22:28.028877 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.028876    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22-extensions-socket-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:22:28.331048 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.330964    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:28.334774 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:22:28.334741    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b77a8b0_f173_4554_adc4_9b2d38b55712.slice/crio-36f3758b326747c2002d44101436928c8c0ec8754997569509becba8d644f646 WatchSource:0}: Error finding container 36f3758b326747c2002d44101436928c8c0ec8754997569509becba8d644f646: Status 404 returned error can't find the container with id 36f3758b326747c2002d44101436928c8c0ec8754997569509becba8d644f646
Sep 18 17:22:28.556519 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.556481    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" path="/var/lib/kubelet/pods/351b1b52-c4e1-4491-a2f9-2d51f4a9bc22/volumes"
Sep 18 17:22:28.560150 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.560118    2584 generic.go:356] "Generic (PLEG): container finished" podID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" containerID="24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329" exitCode=0
Sep 18 17:22:28.560328 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.560177    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:28.560328 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.560214    2584 scope.go:117] "RemoveContainer" containerID="24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329"
Sep 18 17:22:28.562678 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.562646    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" event={"ID":"6b77a8b0-f173-4554-adc4-9b2d38b55712","Type":"ContainerStarted","Data":"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"}
Sep 18 17:22:28.562847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.562708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" event={"ID":"6b77a8b0-f173-4554-adc4-9b2d38b55712","Type":"ContainerStarted","Data":"36f3758b326747c2002d44101436928c8c0ec8754997569509becba8d644f646"}
Sep 18 17:22:28.562847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.562752    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:28.577414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.577261    2584 scope.go:117] "RemoveContainer" containerID="24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329"
Sep 18 17:22:28.577981 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:22:28.577950    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329\": container with ID starting with 24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329 not found: ID does not exist" containerID="24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329"
Sep 18 17:22:28.578120 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.577989    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329"} err="failed to get container status \"24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329\": rpc error: code = NotFound desc = could not find container \"24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329\": container with ID starting with 24d5e246f031e396f4b86a07018c214c3ebc093aefa0623bb1c50280b9bf4329 not found: ID does not exist"
Sep 18 17:22:28.583351 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:22:28.583272    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gmsf9\" is forbidden: User \"system:node:ip-10-0-135-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-187.ec2.internal' and this object" podUID="351b1b52-c4e1-4491-a2f9-2d51f4a9bc22" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gmsf9"
Sep 18 17:22:28.720045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:28.719981    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" podStartSLOduration=1.719964944 podStartE2EDuration="1.719964944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:22:28.652552373 +0000 UTC m=+480.594809981" watchObservedRunningTime="2026-09-18 17:22:28.719964944 +0000 UTC m=+480.662222553"
Sep 18 17:22:39.571881 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:39.571846    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:49.238046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.237998    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:49.238596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.238319    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" podUID="6b77a8b0-f173-4554-adc4-9b2d38b55712" containerName="manager" containerID="cri-o://de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8" gracePeriod=10
Sep 18 17:22:49.485861 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.485832    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:49.606798 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.606752    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume\") pod \"6b77a8b0-f173-4554-adc4-9b2d38b55712\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") "
Sep 18 17:22:49.606994 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.606872    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4tvb\" (UniqueName: \"kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb\") pod \"6b77a8b0-f173-4554-adc4-9b2d38b55712\" (UID: \"6b77a8b0-f173-4554-adc4-9b2d38b55712\") "
Sep 18 17:22:49.607262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.607230    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b77a8b0-f173-4554-adc4-9b2d38b55712" (UID: "6b77a8b0-f173-4554-adc4-9b2d38b55712"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:22:49.609467 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.609425    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb" (OuterVolumeSpecName: "kube-api-access-c4tvb") pod "6b77a8b0-f173-4554-adc4-9b2d38b55712" (UID: "6b77a8b0-f173-4554-adc4-9b2d38b55712"). InnerVolumeSpecName "kube-api-access-c4tvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:22:49.673193 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.673152    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b77a8b0-f173-4554-adc4-9b2d38b55712" containerID="de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8" exitCode=0
Sep 18 17:22:49.673377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.673198    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" event={"ID":"6b77a8b0-f173-4554-adc4-9b2d38b55712","Type":"ContainerDied","Data":"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"}
Sep 18 17:22:49.673377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.673213    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"
Sep 18 17:22:49.673377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.673249    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt" event={"ID":"6b77a8b0-f173-4554-adc4-9b2d38b55712","Type":"ContainerDied","Data":"36f3758b326747c2002d44101436928c8c0ec8754997569509becba8d644f646"}
Sep 18 17:22:49.673377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.673278    2584 scope.go:117] "RemoveContainer" containerID="de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"
Sep 18 17:22:49.683004 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.682981    2584 scope.go:117] "RemoveContainer" containerID="de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"
Sep 18 17:22:49.683344 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:22:49.683322    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8\": container with ID starting with de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8 not found: ID does not exist" containerID="de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"
Sep 18 17:22:49.683423 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.683352    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8"} err="failed to get container status \"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8\": rpc error: code = NotFound desc = could not find container \"de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8\": container with ID starting with de9a4ae5a1eca0f4433c249b0cf649e20fad933638b691aa85386f6d47c13eb8 not found: ID does not exist"
Sep 18 17:22:49.699864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.699831    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:49.707564 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.707503    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4tvb\" (UniqueName: \"kubernetes.io/projected/6b77a8b0-f173-4554-adc4-9b2d38b55712-kube-api-access-c4tvb\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:22:49.707564 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.707537    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b77a8b0-f173-4554-adc4-9b2d38b55712-extensions-socket-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:22:49.709454 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:49.709428    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqxzt"]
Sep 18 17:22:50.555870 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:22:50.555832    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b77a8b0-f173-4554-adc4-9b2d38b55712" path="/var/lib/kubelet/pods/6b77a8b0-f173-4554-adc4-9b2d38b55712/volumes"
Sep 18 17:23:05.736216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.736182    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"]
Sep 18 17:23:05.736659 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.736604    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b77a8b0-f173-4554-adc4-9b2d38b55712" containerName="manager"
Sep 18 17:23:05.736659 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.736620    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b77a8b0-f173-4554-adc4-9b2d38b55712" containerName="manager"
Sep 18 17:23:05.736741 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.736699    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b77a8b0-f173-4554-adc4-9b2d38b55712" containerName="manager"
Sep 18 17:23:05.739929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.739909    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.742677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.742653    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8fwvl\""
Sep 18 17:23:05.754722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.754700    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"]
Sep 18 17:23:05.822957 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.822925    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823083 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.822988    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823083 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823083 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823074    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a80669-9995-405b-83c2-af950b822e12-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823267 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823267 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823164    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823267 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823190    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96g96\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-kube-api-access-96g96\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823417 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.823417 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.823289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a80669-9995-405b-83c2-af950b822e12-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924184    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a80669-9995-405b-83c2-af950b822e12-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924275    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a80669-9995-405b-83c2-af950b822e12-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924383    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924435 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96g96\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-kube-api-access-96g96\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924724 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.924944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.924921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.925162 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.925065    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.925309 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.925286    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7a80669-9995-405b-83c2-af950b822e12-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.926749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.926729    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7a80669-9995-405b-83c2-af950b822e12-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.926973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.926956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7a80669-9995-405b-83c2-af950b822e12-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.933165 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.933140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:05.933265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:05.933148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96g96\" (UniqueName: \"kubernetes.io/projected/a7a80669-9995-405b-83c2-af950b822e12-kube-api-access-96g96\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vwcxb\" (UID: \"a7a80669-9995-405b-83c2-af950b822e12\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:06.050913 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.050832    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:06.344691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.344507    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"]
Sep 18 17:23:06.347614 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:23:06.347586    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a80669_9995_405b_83c2_af950b822e12.slice/crio-92974a34496da117f12fd71da617ae1b4170b0b18d3d5d754401a493a8054f24 WatchSource:0}: Error finding container 92974a34496da117f12fd71da617ae1b4170b0b18d3d5d754401a493a8054f24: Status 404 returned error can't find the container with id 92974a34496da117f12fd71da617ae1b4170b0b18d3d5d754401a493a8054f24
Sep 18 17:23:06.349661 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.349627    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:23:06.349720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.349688    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:23:06.349720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.349715    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:23:06.756978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.756939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" event={"ID":"a7a80669-9995-405b-83c2-af950b822e12","Type":"ContainerStarted","Data":"a77276a336aaafaab56abe7f8601c2684ecb25516a34c66eb75673e9b64bb416"}
Sep 18 17:23:06.757389 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.757000    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" event={"ID":"a7a80669-9995-405b-83c2-af950b822e12","Type":"ContainerStarted","Data":"92974a34496da117f12fd71da617ae1b4170b0b18d3d5d754401a493a8054f24"}
Sep 18 17:23:06.784009 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:06.783953    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podStartSLOduration=1.783938655 podStartE2EDuration="1.783938655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:23:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:23:06.781489266 +0000 UTC m=+518.723746874" watchObservedRunningTime="2026-09-18 17:23:06.783938655 +0000 UTC m=+518.726196264"
Sep 18 17:23:07.051231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:07.051159    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:07.055856 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:07.055827    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:07.762354 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:07.762317    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:07.763359 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:07.763337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:23:08.974409 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:08.974381    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:08.977797 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:08.977778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:08.981023 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:08.981000    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 18 17:23:08.982290 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:08.982272    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-flxjs\""
Sep 18 17:23:08.992767 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:08.992748    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:09.048537 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.048509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tfvj\" (UniqueName: \"kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.048696 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.048544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.070554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.070526    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:09.149146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.149095    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.149292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.149199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tfvj\" (UniqueName: \"kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.149732 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.149705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.165528 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.165508    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tfvj\" (UniqueName: \"kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj\") pod \"limitador-limitador-8588749977-v64p4\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") " pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.288762 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.288681    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:09.569645 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.569621    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:09.570966 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:23:09.570934    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20063152_4b04_40f4_84d7_71196ffc74e9.slice/crio-16781292951e1a7576f3bf6b1e63ca1340982defa3b5d75a8169abec1190a035 WatchSource:0}: Error finding container 16781292951e1a7576f3bf6b1e63ca1340982defa3b5d75a8169abec1190a035: Status 404 returned error can't find the container with id 16781292951e1a7576f3bf6b1e63ca1340982defa3b5d75a8169abec1190a035
Sep 18 17:23:09.773206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:09.773171    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" event={"ID":"20063152-4b04-40f4-84d7-71196ffc74e9","Type":"ContainerStarted","Data":"16781292951e1a7576f3bf6b1e63ca1340982defa3b5d75a8169abec1190a035"}
Sep 18 17:23:10.779171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:10.779141    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" event={"ID":"20063152-4b04-40f4-84d7-71196ffc74e9","Type":"ContainerStarted","Data":"b163302efa13abdeb4d8876240c1a63b8cd9dcb15fe3dabe76ff24f412fc5446"}
Sep 18 17:23:10.779531 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:10.779218    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:10.796872 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:10.796828    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" podStartSLOduration=1.666610832 podStartE2EDuration="2.796813314s" totalImagesPullingTime="1.130202482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:23:10.795518367 +0000 UTC m=+522.737776100" watchObservedRunningTime="2026-09-18 17:23:10.796813314 +0000 UTC m=+522.739070957"
Sep 18 17:23:21.784449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:21.784362    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:23.392844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:23.392811    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:23.393314 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:23.393021    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" podUID="20063152-4b04-40f4-84d7-71196ffc74e9" containerName="limitador" containerID="cri-o://b163302efa13abdeb4d8876240c1a63b8cd9dcb15fe3dabe76ff24f412fc5446" gracePeriod=30
Sep 18 17:23:23.841629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:23.841594    2584 generic.go:356] "Generic (PLEG): container finished" podID="20063152-4b04-40f4-84d7-71196ffc74e9" containerID="b163302efa13abdeb4d8876240c1a63b8cd9dcb15fe3dabe76ff24f412fc5446" exitCode=0
Sep 18 17:23:23.841770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:23.841634    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" event={"ID":"20063152-4b04-40f4-84d7-71196ffc74e9","Type":"ContainerDied","Data":"b163302efa13abdeb4d8876240c1a63b8cd9dcb15fe3dabe76ff24f412fc5446"}
Sep 18 17:23:24.330354 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.330330    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:24.455205 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.455180    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tfvj\" (UniqueName: \"kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj\") pod \"20063152-4b04-40f4-84d7-71196ffc74e9\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") "
Sep 18 17:23:24.455536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.455247    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file\") pod \"20063152-4b04-40f4-84d7-71196ffc74e9\" (UID: \"20063152-4b04-40f4-84d7-71196ffc74e9\") "
Sep 18 17:23:24.455536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.455515    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file" (OuterVolumeSpecName: "config-file") pod "20063152-4b04-40f4-84d7-71196ffc74e9" (UID: "20063152-4b04-40f4-84d7-71196ffc74e9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:23:24.457422 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.457382    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj" (OuterVolumeSpecName: "kube-api-access-6tfvj") pod "20063152-4b04-40f4-84d7-71196ffc74e9" (UID: "20063152-4b04-40f4-84d7-71196ffc74e9"). InnerVolumeSpecName "kube-api-access-6tfvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:23:24.556076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.556048    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/20063152-4b04-40f4-84d7-71196ffc74e9-config-file\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:23:24.556076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.556077    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tfvj\" (UniqueName: \"kubernetes.io/projected/20063152-4b04-40f4-84d7-71196ffc74e9-kube-api-access-6tfvj\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:23:24.847823 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.847803    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-v64p4"
Sep 18 17:23:24.847937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.847798    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-v64p4" event={"ID":"20063152-4b04-40f4-84d7-71196ffc74e9","Type":"ContainerDied","Data":"16781292951e1a7576f3bf6b1e63ca1340982defa3b5d75a8169abec1190a035"}
Sep 18 17:23:24.847982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.847942    2584 scope.go:117] "RemoveContainer" containerID="b163302efa13abdeb4d8876240c1a63b8cd9dcb15fe3dabe76ff24f412fc5446"
Sep 18 17:23:24.875195 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.875169    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:24.891772 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:24.891751    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-v64p4"]
Sep 18 17:23:26.560306 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:26.560271    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20063152-4b04-40f4-84d7-71196ffc74e9" path="/var/lib/kubelet/pods/20063152-4b04-40f4-84d7-71196ffc74e9/volumes"
Sep 18 17:23:29.420351 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.420318    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"]
Sep 18 17:23:29.420790 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.420755    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20063152-4b04-40f4-84d7-71196ffc74e9" containerName="limitador"
Sep 18 17:23:29.420790 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.420772    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="20063152-4b04-40f4-84d7-71196ffc74e9" containerName="limitador"
Sep 18 17:23:29.420897 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.420875    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="20063152-4b04-40f4-84d7-71196ffc74e9" containerName="limitador"
Sep 18 17:23:29.425831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.425808    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.429446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.429423    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 18 17:23:29.429568 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.429533    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 18 17:23:29.429647 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.429629    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 17:23:29.430448 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.430429    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-r7mlf\""
Sep 18 17:23:29.441227 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.441205    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"]
Sep 18 17:23:29.491459 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.491426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrf2m\" (UniqueName: \"kubernetes.io/projected/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-kube-api-access-xrf2m\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.491571 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.491476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-data\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.592480 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.592446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-data\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.592646 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.592519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrf2m\" (UniqueName: \"kubernetes.io/projected/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-kube-api-access-xrf2m\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.592871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.592846    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-data\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.602231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.602208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrf2m\" (UniqueName: \"kubernetes.io/projected/e9891fc7-5541-4bce-98c2-8a7b28e5f6a5-kube-api-access-xrf2m\") pod \"postgres-69fb4594cf-tsrwb\" (UID: \"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:29.736164 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:29.736073    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:30.010441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:30.010412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"]
Sep 18 17:23:30.881003 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:30.880954    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb" event={"ID":"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5","Type":"ContainerStarted","Data":"1808f656ae046ebb91bec8b9f6632e1e19949879af9de8b0aadfe3cb9770303c"}
Sep 18 17:23:35.908865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:35.908831    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb" event={"ID":"e9891fc7-5541-4bce-98c2-8a7b28e5f6a5","Type":"ContainerStarted","Data":"cdec4958d768be56b12ae5117006bc02995828368217cc9b9e5e06ee6e44063e"}
Sep 18 17:23:35.909251 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:35.908896    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:41.941839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:41.941811    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb"
Sep 18 17:23:41.969642 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:41.969588    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tsrwb" podStartSLOduration=8.10850107 podStartE2EDuration="12.969574271s" totalImagesPullingTime="4.861073201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:23:35.936450254 +0000 UTC m=+547.878707863" watchObservedRunningTime="2026-09-18 17:23:41.969574271 +0000 UTC m=+553.911831879"
Sep 18 17:23:49.036550 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.036516    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:23:49.059957 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.059921    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:23:49.060158 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.060040    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.065471 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.065441    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 17:23:49.065471 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.065482    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 17:23:49.065821 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.065804    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 17:23:49.066059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.065940    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vwjqg\""
Sep 18 17:23:49.155904 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.155857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bh4c\" (UniqueName: \"kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.156129 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.155921    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.156129 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.156017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.243128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.243068    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:23:49.245491 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.245471    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.256568 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.256539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.256723 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.256601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bh4c\" (UniqueName: \"kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.256723 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.256639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.256867 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.256849    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:23:49.259517 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.259489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.259618 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.259489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.270122 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.270087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bh4c\" (UniqueName: \"kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c\") pod \"maas-controller-587d97f9bf-tcfsm\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") " pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.357543 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.357513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.357706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.357552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6tcn\" (UniqueName: \"kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.357706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.357568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.373256 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.373225    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:49.458284 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.458246    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.458452 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.458289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6tcn\" (UniqueName: \"kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.458452 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.458315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.460796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.460773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.460867 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.460808    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.468025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.468008    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6tcn\" (UniqueName: \"kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn\") pod \"maas-controller-744bfff48d-zskc2\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") " pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.556413 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.556379    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:49.649223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.649134    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:23:49.846883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.846861    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:23:49.847996 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:23:49.847964    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3bbeab9_e355_488a_af08_28adc2b5eefd.slice/crio-0c85b3baf1494b24bf14d9d6d984a9f4f1c5fa3447c393cd8c3587ab21cda4da WatchSource:0}: Error finding container 0c85b3baf1494b24bf14d9d6d984a9f4f1c5fa3447c393cd8c3587ab21cda4da: Status 404 returned error can't find the container with id 0c85b3baf1494b24bf14d9d6d984a9f4f1c5fa3447c393cd8c3587ab21cda4da
Sep 18 17:23:49.976377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.976286    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" event={"ID":"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e","Type":"ContainerStarted","Data":"f697f27e4eb413c7013d483c6e4b5dd4882b65d3f5787c9d516b72867318d9c1"}
Sep 18 17:23:49.977428 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:49.977410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zskc2" event={"ID":"e3bbeab9-e355-488a-af08-28adc2b5eefd","Type":"ContainerStarted","Data":"0c85b3baf1494b24bf14d9d6d984a9f4f1c5fa3447c393cd8c3587ab21cda4da"}
Sep 18 17:23:52.996302 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:52.996260    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" event={"ID":"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e","Type":"ContainerStarted","Data":"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"}
Sep 18 17:23:52.996781 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:52.996333    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:23:52.997803 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:52.997773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zskc2" event={"ID":"e3bbeab9-e355-488a-af08-28adc2b5eefd","Type":"ContainerStarted","Data":"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"}
Sep 18 17:23:52.997909 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:52.997897    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:23:53.026499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:53.026451    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" podStartSLOduration=1.1854403 podStartE2EDuration="4.026437843s" totalImagesPullingTime="2.840997543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:23:53.024714652 +0000 UTC m=+564.966972262" watchObservedRunningTime="2026-09-18 17:23:53.026437843 +0000 UTC m=+564.968695453"
Sep 18 17:23:53.055431 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:23:53.055384    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744bfff48d-zskc2" podStartSLOduration=1.400335916 podStartE2EDuration="4.055369445s" totalImagesPullingTime="2.655033529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:23:53.052415732 +0000 UTC m=+564.994673340" watchObservedRunningTime="2026-09-18 17:23:53.055369445 +0000 UTC m=+564.997627054"
Sep 18 17:24:04.005067 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.005034    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:24:04.005557 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.005126    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:24:04.076337 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.076302    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:24:04.076542 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.076495    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" podUID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" containerName="manager" containerID="cri-o://81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5" gracePeriod=30
Sep 18 17:24:04.320671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.320645    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:24:04.384658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.384623    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs\") pod \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") "
Sep 18 17:24:04.384843 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.384666    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bh4c\" (UniqueName: \"kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c\") pod \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") "
Sep 18 17:24:04.384843 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.384684    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert\") pod \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\" (UID: \"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e\") "
Sep 18 17:24:04.387081 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.387045    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" (UID: "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:24:04.387081 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.387071    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" (UID: "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:24:04.387251 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.387076    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c" (OuterVolumeSpecName: "kube-api-access-5bh4c") pod "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" (UID: "d3cbe820-5fb1-45d1-b5e6-726f7437fc2e"). InnerVolumeSpecName "kube-api-access-5bh4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:24:04.485360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.485323    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:24:04.485360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.485354    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bh4c\" (UniqueName: \"kubernetes.io/projected/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-kube-api-access-5bh4c\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:24:04.485360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:04.485363    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e-webhook-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:24:05.058441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.058407    2584 generic.go:356] "Generic (PLEG): container finished" podID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" containerID="81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5" exitCode=0
Sep 18 17:24:05.058893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.058450    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-587d97f9bf-tcfsm"
Sep 18 17:24:05.058893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.058467    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" event={"ID":"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e","Type":"ContainerDied","Data":"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"}
Sep 18 17:24:05.058893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.058520    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-587d97f9bf-tcfsm" event={"ID":"d3cbe820-5fb1-45d1-b5e6-726f7437fc2e","Type":"ContainerDied","Data":"f697f27e4eb413c7013d483c6e4b5dd4882b65d3f5787c9d516b72867318d9c1"}
Sep 18 17:24:05.058893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.058541    2584 scope.go:117] "RemoveContainer" containerID="81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"
Sep 18 17:24:05.067224 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.067201    2584 scope.go:117] "RemoveContainer" containerID="81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"
Sep 18 17:24:05.067515 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:24:05.067495    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5\": container with ID starting with 81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5 not found: ID does not exist" containerID="81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"
Sep 18 17:24:05.067589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.067522    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5"} err="failed to get container status \"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5\": rpc error: code = NotFound desc = could not find container \"81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5\": container with ID starting with 81706aebf2175dd5682841c2f9fd1cf2210481788292399e59598d3dba8606a5 not found: ID does not exist"
Sep 18 17:24:05.085506 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.085475    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:24:05.090394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:05.090369    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-587d97f9bf-tcfsm"]
Sep 18 17:24:06.555815 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:06.555781    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" path="/var/lib/kubelet/pods/d3cbe820-5fb1-45d1-b5e6-726f7437fc2e/volumes"
Sep 18 17:24:24.321287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.321250    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:24:24.321837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.321724    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" containerName="manager"
Sep 18 17:24:24.321837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.321741    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" containerName="manager"
Sep 18 17:24:24.321927 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.321840    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cbe820-5fb1-45d1-b5e6-726f7437fc2e" containerName="manager"
Sep 18 17:24:24.325172 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.325150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.329715 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.329691    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 18 17:24:24.329864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.329698    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 18 17:24:24.339784 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.339758    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:24:24.448899 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.448856    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.449101 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.448987    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.449101 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.449024    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc6dn\" (UniqueName: \"kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.449101 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.449048    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.550092 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.550057    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.550283 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.550140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc6dn\" (UniqueName: \"kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.550283 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.550170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.550283 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.550205    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.550449 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:24:24.550306    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 18 17:24:24.550449 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:24:24.550371    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls podName:297f09c9-d51c-4101-8bb1-201fb77aa0fc nodeName:}" failed. No retries permitted until 2026-09-18 17:24:25.050351238 +0000 UTC m=+596.992608831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls") pod "maas-api-7dc567d6f7-8kjzc" (UID: "297f09c9-d51c-4101-8bb1-201fb77aa0fc") : secret "maas-api-serving-cert" not found
Sep 18 17:24:24.550890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.550865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.552789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.552767    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.561980 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.561954    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc6dn\" (UniqueName: \"kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:24.866235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.866199    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"]
Sep 18 17:24:24.869543 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.869519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:24.872117 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.872083    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 18 17:24:24.888339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.888313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"]
Sep 18 17:24:24.940146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.940093    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"]
Sep 18 17:24:24.943545 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.943522    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:24.947009 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.946989    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-blmrd\""
Sep 18 17:24:24.953826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.953803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02b00979-6994-470a-bc52-47d72d624dcb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:24.953924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.953868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hjhn\" (UniqueName: \"kubernetes.io/projected/02b00979-6994-470a-bc52-47d72d624dcb-kube-api-access-7hjhn\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:24.959730 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:24.959703    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"]
Sep 18 17:24:25.055170 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055138    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9276f\" (UniqueName: \"kubernetes.io/projected/059e94b8-4d64-4d01-b298-dd9801ded22b-kube-api-access-9276f\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.055366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02b00979-6994-470a-bc52-47d72d624dcb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:25.055366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:25.055366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059e94b8-4d64-4d01-b298-dd9801ded22b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.055366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hjhn\" (UniqueName: \"kubernetes.io/projected/02b00979-6994-470a-bc52-47d72d624dcb-kube-api-access-7hjhn\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:25.056002 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.055978    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/02b00979-6994-470a-bc52-47d72d624dcb-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:25.057693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.057675    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") pod \"maas-api-7dc567d6f7-8kjzc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") " pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:25.081793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.081762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hjhn\" (UniqueName: \"kubernetes.io/projected/02b00979-6994-470a-bc52-47d72d624dcb-kube-api-access-7hjhn\") pod \"payload-pre-processing-59fbc47bf8-dlvwq\" (UID: \"02b00979-6994-470a-bc52-47d72d624dcb\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:25.156395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.156303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059e94b8-4d64-4d01-b298-dd9801ded22b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.156395 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.156376    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9276f\" (UniqueName: \"kubernetes.io/projected/059e94b8-4d64-4d01-b298-dd9801ded22b-kube-api-access-9276f\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.157047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.157025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/059e94b8-4d64-4d01-b298-dd9801ded22b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.168827 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.168786    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9276f\" (UniqueName: \"kubernetes.io/projected/059e94b8-4d64-4d01-b298-dd9801ded22b-kube-api-access-9276f\") pod \"payload-processing-5b54b7fbb7-vjmzj\" (UID: \"059e94b8-4d64-4d01-b298-dd9801ded22b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.179624 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.179594    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:25.235635 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.235578    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:25.253832 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.253767    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:25.470732 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.470652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"]
Sep 18 17:24:25.475093 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:24:25.475064    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b00979_6994_470a_bc52_47d72d624dcb.slice/crio-337138e4c5f4b70e6de6ddb70cc07756a985a9bed07035c7482d2048502f4f96 WatchSource:0}: Error finding container 337138e4c5f4b70e6de6ddb70cc07756a985a9bed07035c7482d2048502f4f96: Status 404 returned error can't find the container with id 337138e4c5f4b70e6de6ddb70cc07756a985a9bed07035c7482d2048502f4f96
Sep 18 17:24:25.523665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.522048    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:24:25.553596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:25.553571    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"]
Sep 18 17:24:25.555597 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:24:25.555569    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059e94b8_4d64_4d01_b298_dd9801ded22b.slice/crio-72f672415f1f3a2a79066dbaaae16e10ed0ea97cc2be405eadc9bb2c6917015f WatchSource:0}: Error finding container 72f672415f1f3a2a79066dbaaae16e10ed0ea97cc2be405eadc9bb2c6917015f: Status 404 returned error can't find the container with id 72f672415f1f3a2a79066dbaaae16e10ed0ea97cc2be405eadc9bb2c6917015f
Sep 18 17:24:26.163196 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:26.163147    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq" event={"ID":"02b00979-6994-470a-bc52-47d72d624dcb","Type":"ContainerStarted","Data":"337138e4c5f4b70e6de6ddb70cc07756a985a9bed07035c7482d2048502f4f96"}
Sep 18 17:24:26.164560 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:26.164529    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj" event={"ID":"059e94b8-4d64-4d01-b298-dd9801ded22b","Type":"ContainerStarted","Data":"72f672415f1f3a2a79066dbaaae16e10ed0ea97cc2be405eadc9bb2c6917015f"}
Sep 18 17:24:26.165599 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:26.165579    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" event={"ID":"297f09c9-d51c-4101-8bb1-201fb77aa0fc","Type":"ContainerStarted","Data":"f8c05fc4ac87ff221dd6324fb1a97b7b54a39d9f16d689381237058f0a65eabd"}
Sep 18 17:24:28.179540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.179440    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj" event={"ID":"059e94b8-4d64-4d01-b298-dd9801ded22b","Type":"ContainerStarted","Data":"cc4d6adc26be299ec46a6daf5646b00cb0858d4a054fb0c250a81447f1954359"}
Sep 18 17:24:28.180032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.180010    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:28.182168 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.182142    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" event={"ID":"297f09c9-d51c-4101-8bb1-201fb77aa0fc","Type":"ContainerStarted","Data":"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"}
Sep 18 17:24:28.182315 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.182297    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:28.184000 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.183972    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq" event={"ID":"02b00979-6994-470a-bc52-47d72d624dcb","Type":"ContainerStarted","Data":"99ebe2b883d94e5b0946953ac7b085af6dbc3eb60255847f767cdb6d02087be0"}
Sep 18 17:24:28.184446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.184427    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:28.221585 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.221529    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj" podStartSLOduration=1.887574598 podStartE2EDuration="4.221510795s" totalImagesPullingTime="2.333936197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:24:28.199897673 +0000 UTC m=+600.142155283" watchObservedRunningTime="2026-09-18 17:24:28.221510795 +0000 UTC m=+600.163768403"
Sep 18 17:24:28.221993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.221969    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq" podStartSLOduration=1.810379845 podStartE2EDuration="4.221962556s" totalImagesPullingTime="2.411582711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:24:28.219543051 +0000 UTC m=+600.161800664" watchObservedRunningTime="2026-09-18 17:24:28.221962556 +0000 UTC m=+600.164220165"
Sep 18 17:24:28.243122 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.243027    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" podStartSLOduration=1.880254666 podStartE2EDuration="4.24300514s" totalImagesPullingTime="2.362750474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:24:28.240239587 +0000 UTC m=+600.182497197" watchObservedRunningTime="2026-09-18 17:24:28.24300514 +0000 UTC m=+600.185262752"
Sep 18 17:24:28.498796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.498774    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:24:28.500418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:28.500397    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:24:34.195030 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:34.195002    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:24:35.221285 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.221252    2584 generic.go:356] "Generic (PLEG): container finished" podID="a7a80669-9995-405b-83c2-af950b822e12" containerID="a77276a336aaafaab56abe7f8601c2684ecb25516a34c66eb75673e9b64bb416" exitCode=0
Sep 18 17:24:35.221750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.221327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" event={"ID":"a7a80669-9995-405b-83c2-af950b822e12","Type":"ContainerDied","Data":"a77276a336aaafaab56abe7f8601c2684ecb25516a34c66eb75673e9b64bb416"}
Sep 18 17:24:35.221750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.221681    2584 scope.go:117] "RemoveContainer" containerID="a77276a336aaafaab56abe7f8601c2684ecb25516a34c66eb75673e9b64bb416"
Sep 18 17:24:35.222912 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.222884    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:24:35.223017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.222965    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:24:35.223017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:35.222993    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:24:36.231390 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:36.231352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" event={"ID":"a7a80669-9995-405b-83c2-af950b822e12","Type":"ContainerStarted","Data":"22044d8551090638ab8430ed7c907e0db93a32a419a0acd9491d7bb494ce9223"}
Sep 18 17:24:37.052927 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:37.052888    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:24:37.053155 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:37.052938    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vwcxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 17:24:37.053155 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:37.053000    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podUID="a7a80669-9995-405b-83c2-af950b822e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 17:24:37.762522 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:37.762474    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:24:38.052349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:38.052242    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vwcxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 17:24:38.052349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:38.052330    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podUID="a7a80669-9995-405b-83c2-af950b822e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 17:24:39.052007 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:39.051966    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vwcxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 17:24:39.052652 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:39.052618    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podUID="a7a80669-9995-405b-83c2-af950b822e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 17:24:40.052141 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:40.052075    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vwcxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 17:24:40.052759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:40.052724    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podUID="a7a80669-9995-405b-83c2-af950b822e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 17:24:40.195692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:40.195661    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-vjmzj"
Sep 18 17:24:40.195855 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:40.195724    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-dlvwq"
Sep 18 17:24:41.051510 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:41.051466    2584 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vwcxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Sep 18 17:24:41.051816 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:41.051784    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb" podUID="a7a80669-9995-405b-83c2-af950b822e12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Sep 18 17:24:42.055234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:42.055200    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:24:42.056230 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:42.056208    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vwcxb"
Sep 18 17:24:45.065097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.065063    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"]
Sep 18 17:24:45.067504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.067488    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.073186 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.073164    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 18 17:24:45.078015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.077994    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 17:24:45.078941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.078924    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 17:24:45.079039 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.078927    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-htmgb\""
Sep 18 17:24:45.129366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.129555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129371    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.129555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvfmx\" (UniqueName: \"kubernetes.io/projected/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-kube-api-access-kvfmx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.129555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.129555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129533    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.129779 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.129565    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.140331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.140295    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"]
Sep 18 17:24:45.230837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.230799    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.230851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.230979    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231090 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231076    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231157    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvfmx\" (UniqueName: \"kubernetes.io/projected/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-kube-api-access-kvfmx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231272 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231188    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231378 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.231449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.231385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.233236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.233214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.233703 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.233683    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.278919 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.278887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvfmx\" (UniqueName: \"kubernetes.io/projected/ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696-kube-api-access-kvfmx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd\" (UID: \"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.378057 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.378021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:45.658046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.658021    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"]
Sep 18 17:24:45.660215 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:24:45.660180    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2bcb8f_09a5_4db7_8efb_21b2ae3d9696.slice/crio-7dcab97cf2b3061c35bc9cb73f31497f1bc757c3a756360d0a8b6310332a200e WatchSource:0}: Error finding container 7dcab97cf2b3061c35bc9cb73f31497f1bc757c3a756360d0a8b6310332a200e: Status 404 returned error can't find the container with id 7dcab97cf2b3061c35bc9cb73f31497f1bc757c3a756360d0a8b6310332a200e
Sep 18 17:24:45.661652 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:45.661635    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:24:46.310629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:46.310588    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd" event={"ID":"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696","Type":"ContainerStarted","Data":"7dcab97cf2b3061c35bc9cb73f31497f1bc757c3a756360d0a8b6310332a200e"}
Sep 18 17:24:47.317397 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:47.317366    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd" event={"ID":"ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696","Type":"ContainerStarted","Data":"ad96dde63efd867510cb40894ee0ead42da02dc3018f7c7a948a9af23367e9ec"}
Sep 18 17:24:47.370323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:47.370268    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd" podStartSLOduration=1.278977046 podStartE2EDuration="2.370253449s" totalImagesPullingTime="1.091276403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:24:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:24:47.369519059 +0000 UTC m=+619.311776670" watchObservedRunningTime="2026-09-18 17:24:47.370253449 +0000 UTC m=+619.312511130"
Sep 18 17:24:55.378324 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:55.378237    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:55.378324 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:55.378295    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:55.390814 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:55.390789    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:24:56.372457 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:24:56.372431    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd"
Sep 18 17:25:05.068024 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.067992    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"]
Sep 18 17:25:05.075505 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.075479    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.081785 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:25:05.081750    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" is forbidden: User \"system:node:ip-10-0-135-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-135-187.ec2.internal' and this object" podUID="59731c97-8eff-4279-ae92-a24a5df19134" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.081785 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:25:05.081779    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-trlp-test-simulated-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-135-187.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-135-187.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" type="*v1.Secret"
Sep 18 17:25:05.103916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.103880    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"]
Sep 18 17:25:05.212546 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212503    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf9ld\" (UniqueName: \"kubernetes.io/projected/59731c97-8eff-4279-ae92-a24a5df19134-kube-api-access-rf9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.212749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.212749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212614    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.212749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.212749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.212749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.212723    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.313974    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf9ld\" (UniqueName: \"kubernetes.io/projected/59731c97-8eff-4279-ae92-a24a5df19134-kube-api-access-rf9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314094    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314194    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314246 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314224    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314533 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314511    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314584    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.314657 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.314635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.316537 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.316519    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59731c97-8eff-4279-ae92-a24a5df19134-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:05.324347 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:05.324293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf9ld\" (UniqueName: \"kubernetes.io/projected/59731c97-8eff-4279-ae92-a24a5df19134-kube-api-access-rf9ld\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:06.314655 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:25:06.314616    2584 secret.go:189] Couldn't get secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Sep 18 17:25:06.315046 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:25:06.314715    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs podName:59731c97-8eff-4279-ae92-a24a5df19134 nodeName:}" failed. No retries permitted until 2026-09-18 17:25:06.814699334 +0000 UTC m=+638.756956925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs") pod "e2e-trlp-test-simulated-kserve-598466548d-vd6mp" (UID: "59731c97-8eff-4279-ae92-a24a5df19134") : failed to sync secret cache: timed out waiting for the condition
Sep 18 17:25:06.329118 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:06.329077    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 18 17:25:06.826358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:06.826311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:06.829070 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:06.829045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59731c97-8eff-4279-ae92-a24a5df19134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vd6mp\" (UID: \"59731c97-8eff-4279-ae92-a24a5df19134\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:06.886656 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:06.886613    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:07.167681 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:07.167647    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"]
Sep 18 17:25:07.169179 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:25:07.169149    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59731c97_8eff_4279_ae92_a24a5df19134.slice/crio-5d4d5ac0f25fed4f7ae956414ffef3f3dbc2650120378ee85c4d5d0ae7985376 WatchSource:0}: Error finding container 5d4d5ac0f25fed4f7ae956414ffef3f3dbc2650120378ee85c4d5d0ae7985376: Status 404 returned error can't find the container with id 5d4d5ac0f25fed4f7ae956414ffef3f3dbc2650120378ee85c4d5d0ae7985376
Sep 18 17:25:07.420178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:07.420064    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp" event={"ID":"59731c97-8eff-4279-ae92-a24a5df19134","Type":"ContainerStarted","Data":"d28c0960084cb1997f2252f1a6338d34fee7e18f84fb20ccc3db4fe037b4b647"}
Sep 18 17:25:07.420178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:07.420138    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp" event={"ID":"59731c97-8eff-4279-ae92-a24a5df19134","Type":"ContainerStarted","Data":"5d4d5ac0f25fed4f7ae956414ffef3f3dbc2650120378ee85c4d5d0ae7985376"}
Sep 18 17:25:07.445010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:07.444952    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp" podStartSLOduration=2.274514696 podStartE2EDuration="2.444934795s" totalImagesPullingTime="170.420099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:25:07.442522643 +0000 UTC m=+639.384780252" watchObservedRunningTime="2026-09-18 17:25:07.444934795 +0000 UTC m=+639.387192403"
Sep 18 17:25:16.887599 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:16.887555    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:16.888072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:16.887619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:16.900026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:16.900002    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:17.478918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:17.478888    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vd6mp"
Sep 18 17:25:20.023773 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.023738    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"]
Sep 18 17:25:20.029220 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.029194    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.032265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.032240    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 18 17:25:20.038994 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.038965    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"]
Sep 18 17:25:20.141304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.141523 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141325    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f97a132-c159-4cac-bff2-a0c349ca091f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.141523 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.141523 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141424    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r47v\" (UniqueName: \"kubernetes.io/projected/1f97a132-c159-4cac-bff2-a0c349ca091f-kube-api-access-7r47v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.141523 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.141739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.141526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242297    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f97a132-c159-4cac-bff2-a0c349ca091f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r47v\" (UniqueName: \"kubernetes.io/projected/1f97a132-c159-4cac-bff2-a0c349ca091f-kube-api-access-7r47v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242776 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242825    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.242886 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.242849    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.244607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.244579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f97a132-c159-4cac-bff2-a0c349ca091f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.244911 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.244894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f97a132-c159-4cac-bff2-a0c349ca091f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.252835 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.252813    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r47v\" (UniqueName: \"kubernetes.io/projected/1f97a132-c159-4cac-bff2-a0c349ca091f-kube-api-access-7r47v\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-wk89f\" (UID: \"1f97a132-c159-4cac-bff2-a0c349ca091f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.341977 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.341880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:20.625655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:20.625613    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"]
Sep 18 17:25:20.626815 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:25:20.626792    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f97a132_c159_4cac_bff2_a0c349ca091f.slice/crio-8f5a166259ce11e33e0460f92cce0f9d80c443435c4d26c81e749edefb6ab691 WatchSource:0}: Error finding container 8f5a166259ce11e33e0460f92cce0f9d80c443435c4d26c81e749edefb6ab691: Status 404 returned error can't find the container with id 8f5a166259ce11e33e0460f92cce0f9d80c443435c4d26c81e749edefb6ab691
Sep 18 17:25:21.490046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:21.490007    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f" event={"ID":"1f97a132-c159-4cac-bff2-a0c349ca091f","Type":"ContainerStarted","Data":"cfa469f0dc9422841a09ec3bffdb580c0eb2695163e6a008dcbf649936379005"}
Sep 18 17:25:21.490483 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:21.490070    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f" event={"ID":"1f97a132-c159-4cac-bff2-a0c349ca091f","Type":"ContainerStarted","Data":"8f5a166259ce11e33e0460f92cce0f9d80c443435c4d26c81e749edefb6ab691"}
Sep 18 17:25:21.511221 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:21.511172    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f" podStartSLOduration=1.33310424 podStartE2EDuration="1.511156464s" totalImagesPullingTime="178.052224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:25:21.50931656 +0000 UTC m=+653.451574169" watchObservedRunningTime="2026-09-18 17:25:21.511156464 +0000 UTC m=+653.453414072"
Sep 18 17:25:30.342975 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:30.342929    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:30.343610 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:30.343059    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:30.355585 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:30.355558    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:25:30.548154 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:25:30.548097    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-wk89f"
Sep 18 17:26:44.647651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.647604    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:26:44.658532 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.658477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.663698 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.663672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:26:44.665061 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.665036    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-0a2e13-openshift-default-dockercfg-7rglb\""
Sep 18 17:26:44.811178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811142    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811178 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45dpq\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811224    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811317    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811398    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811668 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811512    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.811668 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.811560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.912691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.912691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.912691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912654    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45dpq\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.912691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912674    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912943    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.912993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913335 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.913075    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913335 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.913225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.913364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.913459    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.913950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.913883    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.915294 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.915263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.915736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.915719    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.922814 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.922770    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.923172 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.923150    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45dpq\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq\") pod \"e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") " pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:44.975086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:44.975041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:45.272876 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.272834    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:26:45.275606 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:26:45.275576    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd992764_748f_4ee6_b8e6_0b673256f93c.slice/crio-c58b31bed342bbe9ed843cdfcc37a04212c4802f2cafa04fd74377b23ca5659b WatchSource:0}: Error finding container c58b31bed342bbe9ed843cdfcc37a04212c4802f2cafa04fd74377b23ca5659b: Status 404 returned error can't find the container with id c58b31bed342bbe9ed843cdfcc37a04212c4802f2cafa04fd74377b23ca5659b
Sep 18 17:26:45.278096 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.278061    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:26:45.278200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.278156    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:26:45.278200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.278186    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:26:45.926458 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.926416    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerStarted","Data":"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"}
Sep 18 17:26:45.926916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.926479    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerStarted","Data":"c58b31bed342bbe9ed843cdfcc37a04212c4802f2cafa04fd74377b23ca5659b"}
Sep 18 17:26:45.973999 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.973950    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podStartSLOduration=1.973934722 podStartE2EDuration="1.973934722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:26:45.971391791 +0000 UTC m=+737.913649399" watchObservedRunningTime="2026-09-18 17:26:45.973934722 +0000 UTC m=+737.916192330"
Sep 18 17:26:45.975663 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:45.975645    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:46.981191 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:46.981160    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:47.941171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:47.941138    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:47.942287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:47.942267    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:26:48.915671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:48.915596    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:26:48.920369 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:48.920341    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:48.923210 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:48.923180    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sjtq4\""
Sep 18 17:26:48.923363 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:48.923336    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-5b6d69-serving-cert\""
Sep 18 17:26:48.930733 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:48.930707    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:26:49.051829 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.051797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.051829 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.051841    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.052086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.051874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.052086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.051920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmsln\" (UniqueName: \"kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.152610 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.152579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.152808 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.152620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.152808 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.152644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.152808 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.152792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmsln\" (UniqueName: \"kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.153356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.153331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.155330 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.155306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.155497 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.155476    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.169475 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.169410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmsln\" (UniqueName: \"kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln\") pod \"maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.234310 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.234278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:49.532011 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.531908    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:26:49.550834 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:26:49.550125    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ac85ee_bcbe_4f0f_af87_06cc9aac069c.slice/crio-8215be2e94e3b70e0c1b00bd7f0d28d0efbf60776584a569c0e2767a09573593 WatchSource:0}: Error finding container 8215be2e94e3b70e0c1b00bd7f0d28d0efbf60776584a569c0e2767a09573593: Status 404 returned error can't find the container with id 8215be2e94e3b70e0c1b00bd7f0d28d0efbf60776584a569c0e2767a09573593
Sep 18 17:26:49.702657 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.702607    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:26:49.707245 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.707222    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.708242 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.708222    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:26:49.710064 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.710048    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-5b6d69\""
Sep 18 17:26:49.711476 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.711456    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.713788 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.713763    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-5b6d69-dockercfg-pdkbp\""
Sep 18 17:26:49.718324 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.718302    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:26:49.724979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.724761    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:26:49.858775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.858738    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w668m\" (UniqueName: \"kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.858775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.858783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.859050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.858816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.859050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.858905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcxj2\" (UniqueName: \"kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.954993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.954952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" event={"ID":"62ac85ee-bcbe-4f0f-af87-06cc9aac069c","Type":"ContainerStarted","Data":"8215be2e94e3b70e0c1b00bd7f0d28d0efbf60776584a569c0e2767a09573593"}
Sep 18 17:26:49.959687 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.959656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcxj2\" (UniqueName: \"kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.959844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.959729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w668m\" (UniqueName: \"kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.959844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.959751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.959844 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.959767    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.960570 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.960547    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.960570 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.960561    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:49.969308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.969280    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcxj2\" (UniqueName: \"kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2\") pod \"payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:49.969487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:49.969466    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w668m\" (UniqueName: \"kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m\") pod \"payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:50.020578 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.020525    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:50.028673 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.028642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:50.307879 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.307843    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:26:50.313455 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.313429    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:26:50.313999 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:26:50.313975    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7eb932_873f_4911_be34_b1bc3a3d7b71.slice/crio-4039f68e811085f7c4e2b650c9435d107077fab92b1905227794588654936517 WatchSource:0}: Error finding container 4039f68e811085f7c4e2b650c9435d107077fab92b1905227794588654936517: Status 404 returned error can't find the container with id 4039f68e811085f7c4e2b650c9435d107077fab92b1905227794588654936517
Sep 18 17:26:50.314286 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:26:50.314263    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d95f0bf_3eb2_44e5_92d5_473140bb99d0.slice/crio-cd38500e7cfd92092114b90571919f603ec1003d8bf99fca5edd1b0e8243332b WatchSource:0}: Error finding container cd38500e7cfd92092114b90571919f603ec1003d8bf99fca5edd1b0e8243332b: Status 404 returned error can't find the container with id cd38500e7cfd92092114b90571919f603ec1003d8bf99fca5edd1b0e8243332b
Sep 18 17:26:50.963440 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.963391    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" event={"ID":"3d95f0bf-3eb2-44e5-92d5-473140bb99d0","Type":"ContainerStarted","Data":"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"}
Sep 18 17:26:50.963891 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.963455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" event={"ID":"3d95f0bf-3eb2-44e5-92d5-473140bb99d0","Type":"ContainerStarted","Data":"cd38500e7cfd92092114b90571919f603ec1003d8bf99fca5edd1b0e8243332b"}
Sep 18 17:26:50.963891 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.963520    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:26:50.965217 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.965152    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" event={"ID":"6b7eb932-873f-4911-be34-b1bc3a3d7b71","Type":"ContainerStarted","Data":"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"}
Sep 18 17:26:50.965217 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.965206    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:26:50.965396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.965229    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" event={"ID":"6b7eb932-873f-4911-be34-b1bc3a3d7b71","Type":"ContainerStarted","Data":"4039f68e811085f7c4e2b650c9435d107077fab92b1905227794588654936517"}
Sep 18 17:26:50.967152 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.967123    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" event={"ID":"62ac85ee-bcbe-4f0f-af87-06cc9aac069c","Type":"ContainerStarted","Data":"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"}
Sep 18 17:26:50.967263 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.967176    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:50.989463 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:50.989416    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" podStartSLOduration=1.989403959 podStartE2EDuration="1.989403959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:26:50.987834528 +0000 UTC m=+742.930092138" watchObservedRunningTime="2026-09-18 17:26:50.989403959 +0000 UTC m=+742.931661568"
Sep 18 17:26:51.023783 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.023727    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" podStartSLOduration=2.3125286259999998 podStartE2EDuration="3.023708486s" totalImagesPullingTime="711.17986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:26:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:26:51.020969952 +0000 UTC m=+742.963227562" watchObservedRunningTime="2026-09-18 17:26:51.023708486 +0000 UTC m=+742.965966116"
Sep 18 17:26:51.048992 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.048941    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" podStartSLOduration=2.048924596 podStartE2EDuration="2.048924596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:26:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:26:51.045867353 +0000 UTC m=+742.988124965" watchObservedRunningTime="2026-09-18 17:26:51.048924596 +0000 UTC m=+742.991182212"
Sep 18 17:26:51.417570 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.417540    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:26:51.420880 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.420862    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.426787 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.426763    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-0a2e13-serving-cert\""
Sep 18 17:26:51.459727 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.459703    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:26:51.573536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.573501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.573670 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.573539    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp7q5\" (UniqueName: \"kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.573670 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.573642    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.573769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.573709    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.674247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.674161    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.674247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.674222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.674463 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.674346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp7q5\" (UniqueName: \"kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.674534 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.674457    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.674899 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.674872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.676926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.676904    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.677023 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.676955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.686136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.686098    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp7q5\" (UniqueName: \"kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5\") pod \"maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:51.731163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:51.731140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:52.010789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:52.010761    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:26:52.012170 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:26:52.012145    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf525e37_9334_445d_aa4b_b9ab59bfa3af.slice/crio-1b80b9da69a05c56075c335528e38c3f81e340bf657ff054554b3f655668b5bd WatchSource:0}: Error finding container 1b80b9da69a05c56075c335528e38c3f81e340bf657ff054554b3f655668b5bd: Status 404 returned error can't find the container with id 1b80b9da69a05c56075c335528e38c3f81e340bf657ff054554b3f655668b5bd
Sep 18 17:26:52.984198 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:52.984166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" event={"ID":"df525e37-9334-445d-aa4b-b9ab59bfa3af","Type":"ContainerStarted","Data":"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"}
Sep 18 17:26:52.984371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:52.984259    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:26:52.984371 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:52.984279    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" event={"ID":"df525e37-9334-445d-aa4b-b9ab59bfa3af","Type":"ContainerStarted","Data":"1b80b9da69a05c56075c335528e38c3f81e340bf657ff054554b3f655668b5bd"}
Sep 18 17:26:53.018817 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:53.018771    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" podStartSLOduration=1.428120192 podStartE2EDuration="2.018757034s" totalImagesPullingTime="590.636842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:26:53.018183466 +0000 UTC m=+744.960441075" watchObservedRunningTime="2026-09-18 17:26:53.018757034 +0000 UTC m=+744.961014643"
Sep 18 17:26:56.982358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:56.982329    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:26:58.997655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:26:58.997616    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:27:01.781699 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.781654    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:27:01.785358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.785343    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.788414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.788389    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-535fd3\""
Sep 18 17:27:01.788554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.788399    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-535fd3-dockercfg-9lmk5\""
Sep 18 17:27:01.796538 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.796516    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:27:01.883152 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.883087    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6vq8\" (UniqueName: \"kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.883333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.883162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.977739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.977708    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:27:01.978070 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.978050    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:27:01.983756 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.983733    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6vq8\" (UniqueName: \"kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.983853 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.983766    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.984447 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.984430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:01.997321 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:01.997296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6vq8\" (UniqueName: \"kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8\") pod \"payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") " pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:02.074441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.074349    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:02.078223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.078189    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.081889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.081742    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5cfd4b5c-serving-cert\""
Sep 18 17:27:02.092194 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.092173    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:02.096865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.096696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:02.185660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.185629    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5vz\" (UniqueName: \"kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.185820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.185749    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.185820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.185797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.185820 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.185817    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.286688 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.286655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.286824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.286719    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.286824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.286751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.286824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.286820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5vz\" (UniqueName: \"kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.287011 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:27:02.286957    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-serving-cert: secret "maas-api-e2e-ait-5cfd4b5c-serving-cert" not found
Sep 18 17:27:02.287064 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:27:02.287050    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls podName:6284068c-cced-4333-b64b-20d835805321 nodeName:}" failed. No retries permitted until 2026-09-18 17:27:02.787025718 +0000 UTC m=+754.729283309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls") pod "maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" (UID: "6284068c-cced-4333-b64b-20d835805321") : secret "maas-api-e2e-ait-5cfd4b5c-serving-cert" not found
Sep 18 17:27:02.287358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.287337    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.289826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.289804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.297062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.297035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5vz\" (UniqueName: \"kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.390612 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.390584    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:27:02.392332 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:27:02.392307    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod975f5ba7_33db_4e21_8411_8fb6b8a483fd.slice/crio-67cf1759789ae3cfd3093a6bf020256f27b947f1a61be66f4a779cf9f607276b WatchSource:0}: Error finding container 67cf1759789ae3cfd3093a6bf020256f27b947f1a61be66f4a779cf9f607276b: Status 404 returned error can't find the container with id 67cf1759789ae3cfd3093a6bf020256f27b947f1a61be66f4a779cf9f607276b
Sep 18 17:27:02.793720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.793635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.796062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.796032    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") pod \"maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:02.991555 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:02.991517    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:03.067897 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.067648    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" event={"ID":"975f5ba7-33db-4e21-8411-8fb6b8a483fd","Type":"ContainerStarted","Data":"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"}
Sep 18 17:27:03.067897 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.067718    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" event={"ID":"975f5ba7-33db-4e21-8411-8fb6b8a483fd","Type":"ContainerStarted","Data":"67cf1759789ae3cfd3093a6bf020256f27b947f1a61be66f4a779cf9f607276b"}
Sep 18 17:27:03.069013 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.068947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:03.109100 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.109040    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" podStartSLOduration=2.109019873 podStartE2EDuration="2.109019873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:27:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:27:03.106963476 +0000 UTC m=+755.049221086" watchObservedRunningTime="2026-09-18 17:27:03.109019873 +0000 UTC m=+755.051277482"
Sep 18 17:27:03.330184 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.329644    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:03.331273 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:27:03.331090    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6284068c_cced_4333_b64b_20d835805321.slice/crio-65fa046c3dfadd79629fde3274def289c7ce82cf3ff3bc3e050034e80aeb7bf9 WatchSource:0}: Error finding container 65fa046c3dfadd79629fde3274def289c7ce82cf3ff3bc3e050034e80aeb7bf9: Status 404 returned error can't find the container with id 65fa046c3dfadd79629fde3274def289c7ce82cf3ff3bc3e050034e80aeb7bf9
Sep 18 17:27:03.983283 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.983243    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 17:27:03.983629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:03.983311    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 17:27:04.075499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:04.075414    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" event={"ID":"6284068c-cced-4333-b64b-20d835805321","Type":"ContainerStarted","Data":"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"}
Sep 18 17:27:04.075499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:04.075469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" event={"ID":"6284068c-cced-4333-b64b-20d835805321","Type":"ContainerStarted","Data":"65fa046c3dfadd79629fde3274def289c7ce82cf3ff3bc3e050034e80aeb7bf9"}
Sep 18 17:27:04.075719 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:04.075633    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:04.104263 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:04.104220    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" podStartSLOduration=1.692444995 podStartE2EDuration="2.104206286s" totalImagesPullingTime="411.761291ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:27:04.10374334 +0000 UTC m=+756.046000949" watchObservedRunningTime="2026-09-18 17:27:04.104206286 +0000 UTC m=+756.046463895"
Sep 18 17:27:06.087553 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.087463    2584 generic.go:356] "Generic (PLEG): container finished" podID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerID="485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488" exitCode=0
Sep 18 17:27:06.087553 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.087532    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerDied","Data":"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"}
Sep 18 17:27:06.088035 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.087914    2584 scope.go:117] "RemoveContainer" containerID="485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"
Sep 18 17:27:06.089044 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.089016    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:27:06.089311 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.089092    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:27:06.089311 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:06.089161    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:27:07.094949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:07.094909    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerStarted","Data":"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"}
Sep 18 17:27:07.975601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:07.975559    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:27:07.975806 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:07.975781    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 17:27:07.975854 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:07.975830    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 17:27:08.975484 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:08.975449    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 17:27:08.975859 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:08.975501    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 17:27:09.975890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:09.975845    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 17:27:09.976305 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:09.975947    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 17:27:10.086428 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:10.086400    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:10.976461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:10.976418    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 17:27:10.976936 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:10.976489    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 17:27:11.976304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:11.976264    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 17:27:11.976529 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:11.976344    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 17:27:13.013418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:13.013379    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:27:13.013906 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:13.013878    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:27:13.015201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:13.015178    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:27:14.078375 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.078347    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:27:14.202035 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.202007    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:27:14.205882 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.205858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.209045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.209023    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-2aa65a-dockercfg-q4qs5\""
Sep 18 17:27:14.209436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.209418    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2aa65a\""
Sep 18 17:27:14.229421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.229389    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:27:14.309600 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.309566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.309788 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.309657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7nj2\" (UniqueName: \"kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.411177 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.411136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7nj2\" (UniqueName: \"kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.411388 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.411235    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.411994 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.411972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.440386 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.440358    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7nj2\" (UniqueName: \"kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2\") pod \"payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") " pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.517457 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.517425    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:14.823871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:14.823830    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:27:14.826163 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:27:14.826138    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2c3a36_895f_4f42_ae3d_a43472410b09.slice/crio-d1571d2c6a99cb112728fa7502b2668450f1ed1a27a61e6fda066499cd4baf06 WatchSource:0}: Error finding container d1571d2c6a99cb112728fa7502b2668450f1ed1a27a61e6fda066499cd4baf06: Status 404 returned error can't find the container with id d1571d2c6a99cb112728fa7502b2668450f1ed1a27a61e6fda066499cd4baf06
Sep 18 17:27:15.143187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:15.143100    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" event={"ID":"9f2c3a36-895f-4f42-ae3d-a43472410b09","Type":"ContainerStarted","Data":"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"}
Sep 18 17:27:15.143598 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:15.143196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" event={"ID":"9f2c3a36-895f-4f42-ae3d-a43472410b09","Type":"ContainerStarted","Data":"d1571d2c6a99cb112728fa7502b2668450f1ed1a27a61e6fda066499cd4baf06"}
Sep 18 17:27:15.143598 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:15.143272    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:15.190742 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:15.190672    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" podStartSLOduration=1.190656112 podStartE2EDuration="1.190656112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:27:15.188283803 +0000 UTC m=+767.130541418" watchObservedRunningTime="2026-09-18 17:27:15.190656112 +0000 UTC m=+767.132913773"
Sep 18 17:27:26.150214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:26.150181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:27:27.897438 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:27.897402    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:27.897846 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:27.897636    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" podUID="6284068c-cced-4333-b64b-20d835805321" containerName="maas-api" containerID="cri-o://6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5" gracePeriod=30
Sep 18 17:27:28.154248 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.154189    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:28.217497 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.217467    2584 generic.go:356] "Generic (PLEG): container finished" podID="6284068c-cced-4333-b64b-20d835805321" containerID="6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5" exitCode=0
Sep 18 17:27:28.217658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.217508    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"
Sep 18 17:27:28.217658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.217511    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" event={"ID":"6284068c-cced-4333-b64b-20d835805321","Type":"ContainerDied","Data":"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"}
Sep 18 17:27:28.217658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.217628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz" event={"ID":"6284068c-cced-4333-b64b-20d835805321","Type":"ContainerDied","Data":"65fa046c3dfadd79629fde3274def289c7ce82cf3ff3bc3e050034e80aeb7bf9"}
Sep 18 17:27:28.217658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.217651    2584 scope.go:117] "RemoveContainer" containerID="6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"
Sep 18 17:27:28.228141 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.228093    2584 scope.go:117] "RemoveContainer" containerID="6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"
Sep 18 17:27:28.228509 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:27:28.228487    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5\": container with ID starting with 6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5 not found: ID does not exist" containerID="6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"
Sep 18 17:27:28.228587 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.228522    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5"} err="failed to get container status \"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5\": rpc error: code = NotFound desc = could not find container \"6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5\": container with ID starting with 6eeda907938274b5cdce6b1a024699c6498afbdc0c5c453ceb8fd3fc9d401cc5 not found: ID does not exist"
Sep 18 17:27:28.244439 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244409    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca\") pod \"6284068c-cced-4333-b64b-20d835805321\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") "
Sep 18 17:27:28.244568 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244454    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs\") pod \"6284068c-cced-4333-b64b-20d835805321\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") "
Sep 18 17:27:28.244568 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244514    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl5vz\" (UniqueName: \"kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz\") pod \"6284068c-cced-4333-b64b-20d835805321\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") "
Sep 18 17:27:28.244568 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244550    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") pod \"6284068c-cced-4333-b64b-20d835805321\" (UID: \"6284068c-cced-4333-b64b-20d835805321\") "
Sep 18 17:27:28.244742 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244719    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6284068c-cced-4333-b64b-20d835805321" (UID: "6284068c-cced-4333-b64b-20d835805321"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:27:28.244916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.244890    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6284068c-cced-4333-b64b-20d835805321-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:27:28.246883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.246850    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6284068c-cced-4333-b64b-20d835805321" (UID: "6284068c-cced-4333-b64b-20d835805321"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:27:28.246883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.246869    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz" (OuterVolumeSpecName: "kube-api-access-pl5vz") pod "6284068c-cced-4333-b64b-20d835805321" (UID: "6284068c-cced-4333-b64b-20d835805321"). InnerVolumeSpecName "kube-api-access-pl5vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:27:28.247046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.246886    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6284068c-cced-4333-b64b-20d835805321" (UID: "6284068c-cced-4333-b64b-20d835805321"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:27:28.346299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.346257    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:27:28.346299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.346296    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl5vz\" (UniqueName: \"kubernetes.io/projected/6284068c-cced-4333-b64b-20d835805321-kube-api-access-pl5vz\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:27:28.346503 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.346313    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6284068c-cced-4333-b64b-20d835805321-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:27:28.557365 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.557340    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:28.563540 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:28.563501    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5cfd4b5c-587bd6dc88-66dkz"]
Sep 18 17:27:30.558333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:27:30.558297    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6284068c-cced-4333-b64b-20d835805321" path="/var/lib/kubelet/pods/6284068c-cced-4333-b64b-20d835805321/volumes"
Sep 18 17:28:15.232487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.232386    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:28:15.232952 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.232852    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6284068c-cced-4333-b64b-20d835805321" containerName="maas-api"
Sep 18 17:28:15.232952 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.232865    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6284068c-cced-4333-b64b-20d835805321" containerName="maas-api"
Sep 18 17:28:15.232952 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.232950    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6284068c-cced-4333-b64b-20d835805321" containerName="maas-api"
Sep 18 17:28:15.236446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.236421    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.239690 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.239666    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8bd53078-openshift-default-dockercfg-l67qc\""
Sep 18 17:28:15.253752 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.253720    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:28:15.373916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.373882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.373916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.373918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.373940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.373961    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f44h5\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.374042    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.374192    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.374228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374583 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.374248    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.374583 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.374269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475227    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475269    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475567 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475567 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475339    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475567 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475354    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475661    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f44h5\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475747    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.475932 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475850    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.476076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.475746    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.476076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.476047    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.476270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.476245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.476500 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.476485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.476751 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.476732    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.477851 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.477834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.478065 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.478046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.487234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.487172    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.487334 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.487288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f44h5\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5\") pod \"e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") " pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.548027 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.547993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:15.838602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.838575    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:28:15.839690 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:28:15.839670    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf467e644_8058_40e7_a91c_734ff5ec1f3b.slice/crio-ca11804c67afdc385ea852a9757ffb1e378d26c4b84f5f27f646c69d181c4192 WatchSource:0}: Error finding container ca11804c67afdc385ea852a9757ffb1e378d26c4b84f5f27f646c69d181c4192: Status 404 returned error can't find the container with id ca11804c67afdc385ea852a9757ffb1e378d26c4b84f5f27f646c69d181c4192
Sep 18 17:28:15.842086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.842052    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:15.842202 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.842156    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:15.842266 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:15.842206    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:16.499263 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:16.499219    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerStarted","Data":"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"}
Sep 18 17:28:16.499729 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:16.499276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerStarted","Data":"ca11804c67afdc385ea852a9757ffb1e378d26c4b84f5f27f646c69d181c4192"}
Sep 18 17:28:16.526397 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:16.526347    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podStartSLOduration=1.5263298619999999 podStartE2EDuration="1.526329862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:28:16.522715738 +0000 UTC m=+828.464973346" watchObservedRunningTime="2026-09-18 17:28:16.526329862 +0000 UTC m=+828.468587472"
Sep 18 17:28:16.548355 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:16.548316    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:16.557221 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:16.557196    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:17.505382 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:17.505345    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:17.506250 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:17.506229    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:38.631259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.631177    2584 generic.go:356] "Generic (PLEG): container finished" podID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerID="cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c" exitCode=0
Sep 18 17:28:38.631259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.631232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerDied","Data":"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"}
Sep 18 17:28:38.631719 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.631612    2584 scope.go:117] "RemoveContainer" containerID="cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"
Sep 18 17:28:38.632786 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.632753    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:38.632892 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.632840    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:38.632955 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:38.632889    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:28:39.642363 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:39.642312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerStarted","Data":"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"}
Sep 18 17:28:40.548446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:40.548395    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:40.548668 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:40.548520    2584 patch_prober.go:28] interesting pod/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 18 17:28:40.548668 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:40.548578    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 18 17:28:41.548930 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:41.548891    2584 patch_prober.go:28] interesting pod/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 18 17:28:41.549481 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:41.549011    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 18 17:28:42.548741 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:42.548697    2584 patch_prober.go:28] interesting pod/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 18 17:28:42.549067 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:42.549033    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 18 17:28:43.548626 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:43.548588    2584 patch_prober.go:28] interesting pod/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 18 17:28:43.548918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:43.548889    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 18 17:28:44.548750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:44.548705    2584 patch_prober.go:28] interesting pod/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 18 17:28:44.549257 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:44.548774    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 18 17:28:45.553339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:45.553306    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:45.553802 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:45.553667    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:28:45.554529 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:28:45.554500    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:29:01.712850 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:01.712808    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:29:01.713400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:01.713017    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy" containerID="cri-o://9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405" gracePeriod=30
Sep 18 17:29:06.979979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:06.979951    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068385    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068450    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068541    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068566    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068641    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068668    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068698    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068728    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f44h5\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.069323 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.068756    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs\") pod \"f467e644-8058-40e7-a91c-734ff5ec1f3b\" (UID: \"f467e644-8058-40e7-a91c-734ff5ec1f3b\") "
Sep 18 17:29:07.070007 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.069900    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:29:07.070351 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.070148    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:29:07.070901 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.070577    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:29:07.071646 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.071608    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:29:07.071931 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.071899    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:07.073999 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.073910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:29:07.075825 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.075774    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5" (OuterVolumeSpecName: "kube-api-access-f44h5") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "kube-api-access-f44h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:29:07.079031 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.078990    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:29:07.079234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.079193    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f467e644-8058-40e7-a91c-734ff5ec1f3b" (UID: "f467e644-8058-40e7-a91c-734ff5ec1f3b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 17:29:07.169826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169798    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-envoy\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.169826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169824    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169837    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-credential-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169848    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f44h5\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-kube-api-access-f44h5\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169858    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-workload-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169866    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f467e644-8058-40e7-a91c-734ff5ec1f3b-istiod-ca-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169875    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-podinfo\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169883    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-data\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.170058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.169891    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f467e644-8058-40e7-a91c-734ff5ec1f3b-istio-token\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:07.738831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.738801    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:07.739258 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.739241    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:29:07.739313 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.739262    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:29:07.739359 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.739349    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:29:07.739396 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.739360    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:29:07.741847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.741829    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.744753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.744728    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-fb1cf26a-dockercfg-64hcc\""
Sep 18 17:29:07.744964 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.744949    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-fb1cf26a\""
Sep 18 17:29:07.757466 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.757439    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:07.821030 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.820993    2584 generic.go:356] "Generic (PLEG): container finished" podID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerID="9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405" exitCode=0
Sep 18 17:29:07.821231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.821151    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"
Sep 18 17:29:07.821231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.821156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerDied","Data":"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"}
Sep 18 17:29:07.821388 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.821236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4" event={"ID":"f467e644-8058-40e7-a91c-734ff5ec1f3b","Type":"ContainerDied","Data":"ca11804c67afdc385ea852a9757ffb1e378d26c4b84f5f27f646c69d181c4192"}
Sep 18 17:29:07.821388 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.821273    2584 scope.go:117] "RemoveContainer" containerID="9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"
Sep 18 17:29:07.833263 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.833232    2584 scope.go:117] "RemoveContainer" containerID="cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"
Sep 18 17:29:07.844993 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.844965    2584 scope.go:117] "RemoveContainer" containerID="9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"
Sep 18 17:29:07.845605 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:29:07.845540    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405\": container with ID starting with 9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405 not found: ID does not exist" containerID="9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"
Sep 18 17:29:07.845753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.845610    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405"} err="failed to get container status \"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405\": rpc error: code = NotFound desc = could not find container \"9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405\": container with ID starting with 9cc97520c00881b05285b34194cbeb36ff8f01a2286a12ae9706cfb3c14ce405 not found: ID does not exist"
Sep 18 17:29:07.845829 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.845762    2584 scope.go:117] "RemoveContainer" containerID="cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"
Sep 18 17:29:07.848804 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:29:07.847063    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c\": container with ID starting with cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c not found: ID does not exist" containerID="cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"
Sep 18 17:29:07.848804 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.847147    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c"} err="failed to get container status \"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c\": rpc error: code = NotFound desc = could not find container \"cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c\": container with ID starting with cc7ae8337c0ca0aef3db60c1040cd754304eed2ead81f277de44878aa13df74c not found: ID does not exist"
Sep 18 17:29:07.855245 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.855196    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:29:07.863602 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.859177    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8bd53078-openshift-default-7fb84df8c4-j2tm4"]
Sep 18 17:29:07.878265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.878229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47bx\" (UniqueName: \"kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.878405 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.878268    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.979463 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.979417    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.985965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.979759    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47bx\" (UniqueName: \"kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.985965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.980586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:07.989770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:07.989706    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47bx\" (UniqueName: \"kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx\") pod \"payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") " pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:08.052883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.052836    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:08.334947 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.334915    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:08.336504 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:29:08.336465    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab62f702_a6c2_45c1_bad8_e81684dc10e3.slice/crio-8d60850c43365e91de27a93b076fe66fc8745bc3f8c83802b08f97db6d711960 WatchSource:0}: Error finding container 8d60850c43365e91de27a93b076fe66fc8745bc3f8c83802b08f97db6d711960: Status 404 returned error can't find the container with id 8d60850c43365e91de27a93b076fe66fc8745bc3f8c83802b08f97db6d711960
Sep 18 17:29:08.558374 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.558333    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" path="/var/lib/kubelet/pods/f467e644-8058-40e7-a91c-734ff5ec1f3b/volumes"
Sep 18 17:29:08.828942 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.828899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" event={"ID":"ab62f702-a6c2-45c1-bad8-e81684dc10e3","Type":"ContainerStarted","Data":"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"}
Sep 18 17:29:08.829198 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.828977    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" event={"ID":"ab62f702-a6c2-45c1-bad8-e81684dc10e3","Type":"ContainerStarted","Data":"8d60850c43365e91de27a93b076fe66fc8745bc3f8c83802b08f97db6d711960"}
Sep 18 17:29:08.829198 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.829026    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:08.871768 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:08.871711    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" podStartSLOduration=1.8716945310000002 podStartE2EDuration="1.871694531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:29:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:29:08.869642952 +0000 UTC m=+880.811900561" watchObservedRunningTime="2026-09-18 17:29:08.871694531 +0000 UTC m=+880.813952139"
Sep 18 17:29:19.838381 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:19.838295    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:28.538840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:28.538806    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:29:28.541180 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:28.541159    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:29:32.674048 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.674006    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:29:32.674574 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.674311    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" podUID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" containerName="payload-processing" containerID="cri-o://7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34" gracePeriod=30
Sep 18 17:29:32.948702 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.948673    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:29:32.965472 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.965441    2584 generic.go:356] "Generic (PLEG): container finished" podID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" containerID="7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34" exitCode=0
Sep 18 17:29:32.965641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.965489    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"
Sep 18 17:29:32.965641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.965493    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" event={"ID":"975f5ba7-33db-4e21-8411-8fb6b8a483fd","Type":"ContainerDied","Data":"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"}
Sep 18 17:29:32.965641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.965550    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g" event={"ID":"975f5ba7-33db-4e21-8411-8fb6b8a483fd","Type":"ContainerDied","Data":"67cf1759789ae3cfd3093a6bf020256f27b947f1a61be66f4a779cf9f607276b"}
Sep 18 17:29:32.965641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.965578    2584 scope.go:117] "RemoveContainer" containerID="7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"
Sep 18 17:29:32.977219 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.977080    2584 scope.go:117] "RemoveContainer" containerID="7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"
Sep 18 17:29:32.977565 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:29:32.977543    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34\": container with ID starting with 7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34 not found: ID does not exist" containerID="7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"
Sep 18 17:29:32.977681 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:32.977573    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34"} err="failed to get container status \"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34\": rpc error: code = NotFound desc = could not find container \"7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34\": container with ID starting with 7c0b81a67acb27fb2dbd0e81999680af3a7a146571c8053af07112a1130f3d34 not found: ID does not exist"
Sep 18 17:29:33.028264 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.028232    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume\") pod \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") "
Sep 18 17:29:33.028475 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.028289    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6vq8\" (UniqueName: \"kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8\") pod \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\" (UID: \"975f5ba7-33db-4e21-8411-8fb6b8a483fd\") "
Sep 18 17:29:33.028629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.028605    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "975f5ba7-33db-4e21-8411-8fb6b8a483fd" (UID: "975f5ba7-33db-4e21-8411-8fb6b8a483fd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:33.030605 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.030578    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8" (OuterVolumeSpecName: "kube-api-access-g6vq8") pod "975f5ba7-33db-4e21-8411-8fb6b8a483fd" (UID: "975f5ba7-33db-4e21-8411-8fb6b8a483fd"). InnerVolumeSpecName "kube-api-access-g6vq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:29:33.129704 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.129663    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/975f5ba7-33db-4e21-8411-8fb6b8a483fd-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:33.129704 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.129695    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6vq8\" (UniqueName: \"kubernetes.io/projected/975f5ba7-33db-4e21-8411-8fb6b8a483fd-kube-api-access-g6vq8\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:33.292286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.292250    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:29:33.294847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:33.294823    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-535fd3-6fc57c6957-hq94g"]
Sep 18 17:29:34.557490 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:34.557450    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" path="/var/lib/kubelet/pods/975f5ba7-33db-4e21-8411-8fb6b8a483fd/volumes"
Sep 18 17:29:38.594004 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.593968    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:38.594433 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.594223    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" podUID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" containerName="payload-processing" containerID="cri-o://4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2" gracePeriod=30
Sep 18 17:29:38.861758 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.861732    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:38.984407 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.984374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume\") pod \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") "
Sep 18 17:29:38.984573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.984417    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r47bx\" (UniqueName: \"kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx\") pod \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\" (UID: \"ab62f702-a6c2-45c1-bad8-e81684dc10e3\") "
Sep 18 17:29:38.984812 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.984785    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab62f702-a6c2-45c1-bad8-e81684dc10e3" (UID: "ab62f702-a6c2-45c1-bad8-e81684dc10e3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:29:38.986715 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:38.986680    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx" (OuterVolumeSpecName: "kube-api-access-r47bx") pod "ab62f702-a6c2-45c1-bad8-e81684dc10e3" (UID: "ab62f702-a6c2-45c1-bad8-e81684dc10e3"). InnerVolumeSpecName "kube-api-access-r47bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:29:39.002675 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.002642    2584 generic.go:356] "Generic (PLEG): container finished" podID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" containerID="4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2" exitCode=0
Sep 18 17:29:39.002831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.002683    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"
Sep 18 17:29:39.002831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.002698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" event={"ID":"ab62f702-a6c2-45c1-bad8-e81684dc10e3","Type":"ContainerDied","Data":"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"}
Sep 18 17:29:39.002831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.002757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj" event={"ID":"ab62f702-a6c2-45c1-bad8-e81684dc10e3","Type":"ContainerDied","Data":"8d60850c43365e91de27a93b076fe66fc8745bc3f8c83802b08f97db6d711960"}
Sep 18 17:29:39.002831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.002781    2584 scope.go:117] "RemoveContainer" containerID="4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"
Sep 18 17:29:39.015128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.015050    2584 scope.go:117] "RemoveContainer" containerID="4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"
Sep 18 17:29:39.015931 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:29:39.015896    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2\": container with ID starting with 4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2 not found: ID does not exist" containerID="4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"
Sep 18 17:29:39.016049 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.015942    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2"} err="failed to get container status \"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2\": rpc error: code = NotFound desc = could not find container \"4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2\": container with ID starting with 4c73012734a049ea07f2fe9b8dadcff487ad4c0131a26b807aabc2e925c2b5f2 not found: ID does not exist"
Sep 18 17:29:39.033741 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.033704    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:39.039527 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.039336    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-fb1cf26a-685556477c-rtblj"]
Sep 18 17:29:39.086231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.086189    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab62f702-a6c2-45c1-bad8-e81684dc10e3-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:39.086231 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:39.086222    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r47bx\" (UniqueName: \"kubernetes.io/projected/ab62f702-a6c2-45c1-bad8-e81684dc10e3-kube-api-access-r47bx\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:29:40.556872 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:29:40.556839    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" path="/var/lib/kubelet/pods/ab62f702-a6c2-45c1-bad8-e81684dc10e3/volumes"
Sep 18 17:30:25.710470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.710423    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:30:25.711301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711233    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:30:25.711301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711256    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f467e644-8058-40e7-a91c-734ff5ec1f3b" containerName="istio-proxy"
Sep 18 17:30:25.711301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711273    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" containerName="payload-processing"
Sep 18 17:30:25.711301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711281    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" containerName="payload-processing"
Sep 18 17:30:25.711559 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711311    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" containerName="payload-processing"
Sep 18 17:30:25.711559 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711319    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" containerName="payload-processing"
Sep 18 17:30:25.711559 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711419    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab62f702-a6c2-45c1-bad8-e81684dc10e3" containerName="payload-processing"
Sep 18 17:30:25.711559 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.711434    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="975f5ba7-33db-4e21-8411-8fb6b8a483fd" containerName="payload-processing"
Sep 18 17:30:25.714566 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.714534    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.719250 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.719226    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2aa65a\"/\"openshift-service-ca.crt\""
Sep 18 17:30:25.719504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.719487    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2aa65a\"/\"test-model-2aa65a-kserve-self-signed-certs\""
Sep 18 17:30:25.719575 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.719527    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2aa65a\"/\"kube-root-ca.crt\""
Sep 18 17:30:25.719638 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.719581    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2aa65a\"/\"default-dockercfg-qjvw5\""
Sep 18 17:30:25.728175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.728151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:30:25.819451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819414    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.819451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.819677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.819677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819577    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn6mg\" (UniqueName: \"kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.819677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.819677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.819634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920330    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn6mg\" (UniqueName: \"kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920408    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.920912 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.920886    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.921391 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.921199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.921494 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.921466    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.923544 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.923522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.924068 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.924051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.931093 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.931062    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn6mg\" (UniqueName: \"kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg\") pod \"test-model-2aa65a-kserve-6b5495c449-vzxsr\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") " pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:25.945642 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.945620    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:30:25.949274 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.949259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:25.952652 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.952632    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-97798a-dockercfg-b8m75\""
Sep 18 17:30:25.953019 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.953001    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-97798a\""
Sep 18 17:30:25.967925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:25.967847    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:30:26.020931 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.020892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.021136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.020944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5nm\" (UniqueName: \"kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.024497 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.024474    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:26.124752 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.124590    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.124752 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.124649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5nm\" (UniqueName: \"kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.126706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.126646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.140656 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.140624    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5nm\" (UniqueName: \"kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm\") pod \"payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.261236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.261143    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:26.326247 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.326164    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:30:26.331824 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:30:26.331796    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dba3b10_f411_4420_b773_ed2f52c57e68.slice/crio-e0d5c5e3be151b65412b98b93bc90b22230dba76963c119f8fe595b7514f904f WatchSource:0}: Error finding container e0d5c5e3be151b65412b98b93bc90b22230dba76963c119f8fe595b7514f904f: Status 404 returned error can't find the container with id e0d5c5e3be151b65412b98b93bc90b22230dba76963c119f8fe595b7514f904f
Sep 18 17:30:26.559403 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:30:26.559371    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b49af3_1148_44f4_8587_56becbaa31cc.slice/crio-23f7f23ff680659d2a37ce768054658dbc6e9d3946c44899530c37f77e0a0026 WatchSource:0}: Error finding container 23f7f23ff680659d2a37ce768054658dbc6e9d3946c44899530c37f77e0a0026: Status 404 returned error can't find the container with id 23f7f23ff680659d2a37ce768054658dbc6e9d3946c44899530c37f77e0a0026
Sep 18 17:30:26.561050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:26.561028    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:30:27.273888 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.273850    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" event={"ID":"6dba3b10-f411-4420-b773-ed2f52c57e68","Type":"ContainerStarted","Data":"204d9e2a567cc9c6dd9d679cd7d7083661df2299087078919a3662aaa3b7c54e"}
Sep 18 17:30:27.274376 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.273897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" event={"ID":"6dba3b10-f411-4420-b773-ed2f52c57e68","Type":"ContainerStarted","Data":"e0d5c5e3be151b65412b98b93bc90b22230dba76963c119f8fe595b7514f904f"}
Sep 18 17:30:27.275615 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.275585    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" event={"ID":"e5b49af3-1148-44f4-8587-56becbaa31cc","Type":"ContainerStarted","Data":"98c08c929d0cf9e6e3ad99d2dc7c3df8edae104b07db83cf60323995dd69c389"}
Sep 18 17:30:27.275747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.275641    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" event={"ID":"e5b49af3-1148-44f4-8587-56becbaa31cc","Type":"ContainerStarted","Data":"23f7f23ff680659d2a37ce768054658dbc6e9d3946c44899530c37f77e0a0026"}
Sep 18 17:30:27.275747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.275674    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:30:27.317183 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.317127    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" podStartSLOduration=2.317094537 podStartE2EDuration="2.317094537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:30:27.31460819 +0000 UTC m=+959.256865799" watchObservedRunningTime="2026-09-18 17:30:27.317094537 +0000 UTC m=+959.259352145"
Sep 18 17:30:27.343252 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:27.343204    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" podStartSLOduration=2.343188875 podStartE2EDuration="2.343188875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:30:27.342141442 +0000 UTC m=+959.284399054" watchObservedRunningTime="2026-09-18 17:30:27.343188875 +0000 UTC m=+959.285446484"
Sep 18 17:30:36.025152 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:36.025117    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:36.025533 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:36.025377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:36.037871 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:36.037843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:36.339255 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:36.339178    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:30:38.284672 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:30:38.284637    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:31:33.028214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.028171    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:31:33.031914 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.031897    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.034928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.034904    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-55a2c1b6\""
Sep 18 17:31:33.035045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.034963    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-55a2c1b6-dockercfg-pfdns\""
Sep 18 17:31:33.044199 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.044174    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:31:33.143769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.143731    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9z8m\" (UniqueName: \"kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.144015 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.143892    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.244777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.244734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.244974 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.244849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9z8m\" (UniqueName: \"kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.245581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.245560    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.254132 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.254086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9z8m\" (UniqueName: \"kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m\") pod \"payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.343779 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.343689    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:33.620170 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.620141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:31:33.622258 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:31:33.622228    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fa072a_114c_4d3a_9d0a_fa5fd0310478.slice/crio-4fd87a4fd5603aa96e39999fe0ee0e0b7b573c91cf5a4c2a147ee6878d25a82d WatchSource:0}: Error finding container 4fd87a4fd5603aa96e39999fe0ee0e0b7b573c91cf5a4c2a147ee6878d25a82d: Status 404 returned error can't find the container with id 4fd87a4fd5603aa96e39999fe0ee0e0b7b573c91cf5a4c2a147ee6878d25a82d
Sep 18 17:31:33.661789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:33.661755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" event={"ID":"c5fa072a-114c-4d3a-9d0a-fa5fd0310478","Type":"ContainerStarted","Data":"4fd87a4fd5603aa96e39999fe0ee0e0b7b573c91cf5a4c2a147ee6878d25a82d"}
Sep 18 17:31:34.670157 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:34.670092    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" event={"ID":"c5fa072a-114c-4d3a-9d0a-fa5fd0310478","Type":"ContainerStarted","Data":"48ab09a2bb34d18cb4cc88fa8dab85a781231a418c39dd810d72c419f5b0849c"}
Sep 18 17:31:34.670623 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:34.670233    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:34.696536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:34.696435    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" podStartSLOduration=1.6964156620000002 podStartE2EDuration="1.696415662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:31:34.691891844 +0000 UTC m=+1026.634149456" watchObservedRunningTime="2026-09-18 17:31:34.696415662 +0000 UTC m=+1026.638673271"
Sep 18 17:31:45.677810 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:45.677778    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:31:59.446378 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.446345    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:31:59.449889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.449871    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.454459 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.454397    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"default-dockercfg-r86nm\""
Sep 18 17:31:59.454596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.454469    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"kube-root-ca.crt\""
Sep 18 17:31:59.454596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.454408    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"openshift-service-ca.crt\""
Sep 18 17:31:59.454596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.454417    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"e2e-conflict-a-b4eda83d-kserve-self-signed-certs\""
Sep 18 17:31:59.461632 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.461608    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:31:59.592956 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.592918    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.592956 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.592964    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.593232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.592987    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm592\" (UniqueName: \"kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.593232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.593062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.593232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.593172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.593232 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.593194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.693974    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694011    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694086    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm592\" (UniqueName: \"kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694538 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694449    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694538 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694510    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.694618 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.694561    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.696621 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.696566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.696884 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.696866    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.723499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.723475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm592\" (UniqueName: \"kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592\") pod \"e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:31:59.760508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:31:59.760476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:32:00.035654 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:00.035628    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:32:00.037067 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:32:00.037040    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2a3461_8760_4bab_b95e_b33bb60b96d7.slice/crio-36ddeb974ce0074964348236daa7b449fadc84d5461891991156ed5723f1ca5e WatchSource:0}: Error finding container 36ddeb974ce0074964348236daa7b449fadc84d5461891991156ed5723f1ca5e: Status 404 returned error can't find the container with id 36ddeb974ce0074964348236daa7b449fadc84d5461891991156ed5723f1ca5e
Sep 18 17:32:00.833738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:00.833698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" event={"ID":"2e2a3461-8760-4bab-b95e-b33bb60b96d7","Type":"ContainerStarted","Data":"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"}
Sep 18 17:32:00.833738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:00.833739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" event={"ID":"2e2a3461-8760-4bab-b95e-b33bb60b96d7","Type":"ContainerStarted","Data":"36ddeb974ce0074964348236daa7b449fadc84d5461891991156ed5723f1ca5e"}
Sep 18 17:32:00.853443 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:00.853393    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" podStartSLOduration=1.85337518 podStartE2EDuration="1.85337518s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:32:00.850904813 +0000 UTC m=+1052.793162439" watchObservedRunningTime="2026-09-18 17:32:00.85337518 +0000 UTC m=+1052.795632817"
Sep 18 17:32:09.761520 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:09.761480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:32:09.761991 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:09.761541    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:32:09.774463 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:09.774435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:32:09.915182 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:09.915148    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:32:10.195254 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.195219    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:32:10.199334 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.199309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.203439 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.203415    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0a2e13\"/\"default-dockercfg-c4wdl\""
Sep 18 17:32:10.203711 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.203693    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0a2e13\"/\"kube-root-ca.crt\""
Sep 18 17:32:10.203868 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.203574    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0a2e13\"/\"openshift-service-ca.crt\""
Sep 18 17:32:10.204006 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.203506    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0a2e13\"/\"distinct-w0-0a2e13-kserve-self-signed-certs\""
Sep 18 17:32:10.209647 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.209621    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:32:10.298219 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.298181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.300564 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.300531    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.300929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.300902    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.301200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.301180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk44g\" (UniqueName: \"kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.301403 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.301386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.302140 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.302099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.403884 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.403848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.403884 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.403882    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.403925    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.403978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk44g\" (UniqueName: \"kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.404012    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.404151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.404385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404478 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.404389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.404533 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.404469    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.406553 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.406514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.406660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.406642    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.424705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.424674    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk44g\" (UniqueName: \"kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g\") pod \"distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") " pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.512245 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.512151    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:10.793306 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.793278    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:32:10.794230 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:32:10.794204    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd67df7b8_6b70_4d5f_9172_bcb0147262f6.slice/crio-9b24694c346ebbbcf677cf077768c7d8e916e5fda9283386682b82c1b24c3d03 WatchSource:0}: Error finding container 9b24694c346ebbbcf677cf077768c7d8e916e5fda9283386682b82c1b24c3d03: Status 404 returned error can't find the container with id 9b24694c346ebbbcf677cf077768c7d8e916e5fda9283386682b82c1b24c3d03
Sep 18 17:32:10.905224 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.905185    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" event={"ID":"d67df7b8-6b70-4d5f-9172-bcb0147262f6","Type":"ContainerStarted","Data":"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"}
Sep 18 17:32:10.905379 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.905236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" event={"ID":"d67df7b8-6b70-4d5f-9172-bcb0147262f6","Type":"ContainerStarted","Data":"9b24694c346ebbbcf677cf077768c7d8e916e5fda9283386682b82c1b24c3d03"}
Sep 18 17:32:10.926979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:10.926932    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" podStartSLOduration=0.926917633 podStartE2EDuration="926.917633ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:32:10.925465442 +0000 UTC m=+1062.867723050" watchObservedRunningTime="2026-09-18 17:32:10.926917633 +0000 UTC m=+1062.869175311"
Sep 18 17:32:14.720603 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:14.720567    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:32:14.721136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:14.720798    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" podUID="e5b49af3-1148-44f4-8587-56becbaa31cc" containerName="payload-pre-processing" containerID="cri-o://98c08c929d0cf9e6e3ad99d2dc7c3df8edae104b07db83cf60323995dd69c389" gracePeriod=30
Sep 18 17:32:14.933314 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:14.933277    2584 generic.go:356] "Generic (PLEG): container finished" podID="e5b49af3-1148-44f4-8587-56becbaa31cc" containerID="98c08c929d0cf9e6e3ad99d2dc7c3df8edae104b07db83cf60323995dd69c389" exitCode=0
Sep 18 17:32:14.933498 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:14.933356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" event={"ID":"e5b49af3-1148-44f4-8587-56becbaa31cc","Type":"ContainerDied","Data":"98c08c929d0cf9e6e3ad99d2dc7c3df8edae104b07db83cf60323995dd69c389"}
Sep 18 17:32:15.005949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.005916    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:32:15.047194 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.047158    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume\") pod \"e5b49af3-1148-44f4-8587-56becbaa31cc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") "
Sep 18 17:32:15.047390 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.047258    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb5nm\" (UniqueName: \"kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm\") pod \"e5b49af3-1148-44f4-8587-56becbaa31cc\" (UID: \"e5b49af3-1148-44f4-8587-56becbaa31cc\") "
Sep 18 17:32:15.047613 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.047587    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5b49af3-1148-44f4-8587-56becbaa31cc" (UID: "e5b49af3-1148-44f4-8587-56becbaa31cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:32:15.049695 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.049671    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm" (OuterVolumeSpecName: "kube-api-access-mb5nm") pod "e5b49af3-1148-44f4-8587-56becbaa31cc" (UID: "e5b49af3-1148-44f4-8587-56becbaa31cc"). InnerVolumeSpecName "kube-api-access-mb5nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:32:15.148837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.148796    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5b49af3-1148-44f4-8587-56becbaa31cc-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:32:15.148837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.148832    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb5nm\" (UniqueName: \"kubernetes.io/projected/e5b49af3-1148-44f4-8587-56becbaa31cc-kube-api-access-mb5nm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:32:15.942146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.942115    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"
Sep 18 17:32:15.942146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.942122    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc" event={"ID":"e5b49af3-1148-44f4-8587-56becbaa31cc","Type":"ContainerDied","Data":"23f7f23ff680659d2a37ce768054658dbc6e9d3946c44899530c37f77e0a0026"}
Sep 18 17:32:15.942686 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.942197    2584 scope.go:117] "RemoveContainer" containerID="98c08c929d0cf9e6e3ad99d2dc7c3df8edae104b07db83cf60323995dd69c389"
Sep 18 17:32:15.968524 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.968492    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:32:15.972370 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:15.972342    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-97798a-9d464f8f4-9hffc"]
Sep 18 17:32:16.557054 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:16.557022    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5b49af3-1148-44f4-8587-56becbaa31cc" path="/var/lib/kubelet/pods/e5b49af3-1148-44f4-8587-56becbaa31cc/volumes"
Sep 18 17:32:17.774946 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:17.774914    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:32:17.775527 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:17.775191    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" podUID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" containerName="payload-pre-processing" containerID="cri-o://48ab09a2bb34d18cb4cc88fa8dab85a781231a418c39dd810d72c419f5b0849c" gracePeriod=30
Sep 18 17:32:17.960091 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:17.960048    2584 generic.go:356] "Generic (PLEG): container finished" podID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" containerID="48ab09a2bb34d18cb4cc88fa8dab85a781231a418c39dd810d72c419f5b0849c" exitCode=0
Sep 18 17:32:17.960342 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:17.960259    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" event={"ID":"c5fa072a-114c-4d3a-9d0a-fa5fd0310478","Type":"ContainerDied","Data":"48ab09a2bb34d18cb4cc88fa8dab85a781231a418c39dd810d72c419f5b0849c"}
Sep 18 17:32:18.042002 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.041923    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:32:18.075284 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.075255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume\") pod \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") "
Sep 18 17:32:18.075456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.075299    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9z8m\" (UniqueName: \"kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m\") pod \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\" (UID: \"c5fa072a-114c-4d3a-9d0a-fa5fd0310478\") "
Sep 18 17:32:18.075654 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.075621    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5fa072a-114c-4d3a-9d0a-fa5fd0310478" (UID: "c5fa072a-114c-4d3a-9d0a-fa5fd0310478"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:32:18.077724 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.077700    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m" (OuterVolumeSpecName: "kube-api-access-n9z8m") pod "c5fa072a-114c-4d3a-9d0a-fa5fd0310478" (UID: "c5fa072a-114c-4d3a-9d0a-fa5fd0310478"). InnerVolumeSpecName "kube-api-access-n9z8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:32:18.176785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.176750    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:32:18.176785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.176781    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9z8m\" (UniqueName: \"kubernetes.io/projected/c5fa072a-114c-4d3a-9d0a-fa5fd0310478-kube-api-access-n9z8m\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:32:18.968080 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.968047    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"
Sep 18 17:32:18.968080 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.968078    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj" event={"ID":"c5fa072a-114c-4d3a-9d0a-fa5fd0310478","Type":"ContainerDied","Data":"4fd87a4fd5603aa96e39999fe0ee0e0b7b573c91cf5a4c2a147ee6878d25a82d"}
Sep 18 17:32:18.968080 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.968155    2584 scope.go:117] "RemoveContainer" containerID="48ab09a2bb34d18cb4cc88fa8dab85a781231a418c39dd810d72c419f5b0849c"
Sep 18 17:32:18.991008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.990972    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:32:18.998047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:18.998012    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-55a2c1b6-65c6f69c86-rqwdj"]
Sep 18 17:32:20.512693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:20.512657    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:20.513361 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:20.513338    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:20.529481 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:20.529445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:32:20.556951 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:20.556914    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" path="/var/lib/kubelet/pods/c5fa072a-114c-4d3a-9d0a-fa5fd0310478/volumes"
Sep 18 17:32:20.991697 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:32:20.991654    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:33:21.914313 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914276    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:33:21.914929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914844    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b49af3-1148-44f4-8587-56becbaa31cc" containerName="payload-pre-processing"
Sep 18 17:33:21.914929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914861    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b49af3-1148-44f4-8587-56becbaa31cc" containerName="payload-pre-processing"
Sep 18 17:33:21.914929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914882    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" containerName="payload-pre-processing"
Sep 18 17:33:21.914929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914891    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" containerName="payload-pre-processing"
Sep 18 17:33:21.915179 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914955    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5fa072a-114c-4d3a-9d0a-fa5fd0310478" containerName="payload-pre-processing"
Sep 18 17:33:21.915179 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.914970    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b49af3-1148-44f4-8587-56becbaa31cc" containerName="payload-pre-processing"
Sep 18 17:33:21.917906 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.917882    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:21.920736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.920706    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-66efa6-serving-cert\""
Sep 18 17:33:21.929219 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:21.929182    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:33:22.007692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.007657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.007891 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.007709    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.007891 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.007745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.007891 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.007819    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk74m\" (UniqueName: \"kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.109140 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.109091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.109339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.109160    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.109339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.109193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.109339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.109241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk74m\" (UniqueName: \"kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.109468 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:33:22.109332    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-serving-cert: secret "maas-api-e2e-shared-b-w2-66efa6-serving-cert" not found
Sep 18 17:33:22.109468 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:33:22.109449    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls podName:8d51620a-decd-42ff-bb36-ce6e210d05ae nodeName:}" failed. No retries permitted until 2026-09-18 17:33:22.609425216 +0000 UTC m=+1134.551682818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls") pod "maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae") : secret "maas-api-e2e-shared-b-w2-66efa6-serving-cert" not found
Sep 18 17:33:22.109851 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.109828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.111801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.111780    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.119554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.119532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk74m\" (UniqueName: \"kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.615504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:22.615453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:22.615712 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:33:22.615560    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-serving-cert: secret "maas-api-e2e-shared-b-w2-66efa6-serving-cert" not found
Sep 18 17:33:22.615712 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:33:22.615632    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls podName:8d51620a-decd-42ff-bb36-ce6e210d05ae nodeName:}" failed. No retries permitted until 2026-09-18 17:33:23.615614569 +0000 UTC m=+1135.557872168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls") pod "maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae") : secret "maas-api-e2e-shared-b-w2-66efa6-serving-cert" not found
Sep 18 17:33:23.625298 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:23.625248    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:23.628022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:23.627998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:23.731321 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:23.731277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:24.016557 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:24.016527    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:33:24.017793 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:33:24.017766    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d51620a_decd_42ff_bb36_ce6e210d05ae.slice/crio-c2af2b7329e6c42768b8a5c48ab09204b8b9630d3314017c7fa4d0a116865713 WatchSource:0}: Error finding container c2af2b7329e6c42768b8a5c48ab09204b8b9630d3314017c7fa4d0a116865713: Status 404 returned error can't find the container with id c2af2b7329e6c42768b8a5c48ab09204b8b9630d3314017c7fa4d0a116865713
Sep 18 17:33:24.019308 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:24.019286    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:33:24.346890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:24.346796    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" event={"ID":"8d51620a-decd-42ff-bb36-ce6e210d05ae","Type":"ContainerStarted","Data":"c2af2b7329e6c42768b8a5c48ab09204b8b9630d3314017c7fa4d0a116865713"}
Sep 18 17:33:25.354950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:25.354912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" event={"ID":"8d51620a-decd-42ff-bb36-ce6e210d05ae","Type":"ContainerStarted","Data":"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"}
Sep 18 17:33:25.355399 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:25.355045    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:25.374586 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:25.374538    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" podStartSLOduration=3.912104103 podStartE2EDuration="4.374513877s" totalImagesPullingTime="462.409774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:33:25.372436832 +0000 UTC m=+1137.314694453" watchObservedRunningTime="2026-09-18 17:33:25.374513877 +0000 UTC m=+1137.316771535"
Sep 18 17:33:31.366313 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:31.366281    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:33:38.288877 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:38.288841    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:33:46.054583 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.054543    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:33:46.057446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.054776    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerName="payload-processing" containerID="cri-o://54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e" gracePeriod=30
Sep 18 17:33:46.149093 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.149050    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.50:9004: connect: connection refused"
Sep 18 17:33:46.332908 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.332878    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:33:46.434436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.434385    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume\") pod \"9f2c3a36-895f-4f42-ae3d-a43472410b09\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") "
Sep 18 17:33:46.434637 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.434506    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7nj2\" (UniqueName: \"kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2\") pod \"9f2c3a36-895f-4f42-ae3d-a43472410b09\" (UID: \"9f2c3a36-895f-4f42-ae3d-a43472410b09\") "
Sep 18 17:33:46.434842 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.434812    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f2c3a36-895f-4f42-ae3d-a43472410b09" (UID: "9f2c3a36-895f-4f42-ae3d-a43472410b09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:33:46.436877 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.436842    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2" (OuterVolumeSpecName: "kube-api-access-q7nj2") pod "9f2c3a36-895f-4f42-ae3d-a43472410b09" (UID: "9f2c3a36-895f-4f42-ae3d-a43472410b09"). InnerVolumeSpecName "kube-api-access-q7nj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:33:46.481639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.481604    2584 generic.go:356] "Generic (PLEG): container finished" podID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerID="54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e" exitCode=0
Sep 18 17:33:46.481832 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.481646    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"
Sep 18 17:33:46.481832 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.481685    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" event={"ID":"9f2c3a36-895f-4f42-ae3d-a43472410b09","Type":"ContainerDied","Data":"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"}
Sep 18 17:33:46.481832 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.481739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p" event={"ID":"9f2c3a36-895f-4f42-ae3d-a43472410b09","Type":"ContainerDied","Data":"d1571d2c6a99cb112728fa7502b2668450f1ed1a27a61e6fda066499cd4baf06"}
Sep 18 17:33:46.481832 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.481762    2584 scope.go:117] "RemoveContainer" containerID="54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"
Sep 18 17:33:46.491883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.491862    2584 scope.go:117] "RemoveContainer" containerID="54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"
Sep 18 17:33:46.492202 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:33:46.492182    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e\": container with ID starting with 54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e not found: ID does not exist" containerID="54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"
Sep 18 17:33:46.492270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.492212    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e"} err="failed to get container status \"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e\": rpc error: code = NotFound desc = could not find container \"54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e\": container with ID starting with 54e80c3f828854f7f4cd53cbe897165103b7968fc01739655684ca15b069be3e not found: ID does not exist"
Sep 18 17:33:46.503047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.503020    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:33:46.511603 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.511578    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-2aa65a-65dc9b75f9-s4g8p"]
Sep 18 17:33:46.535937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.535901    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7nj2\" (UniqueName: \"kubernetes.io/projected/9f2c3a36-895f-4f42-ae3d-a43472410b09-kube-api-access-q7nj2\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:46.535937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.535938    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f2c3a36-895f-4f42-ae3d-a43472410b09-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:46.566802 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:46.566716    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" path="/var/lib/kubelet/pods/9f2c3a36-895f-4f42-ae3d-a43472410b09/volumes"
Sep 18 17:33:53.310238 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.310143    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" podUID="6dba3b10-f411-4420-b773-ed2f52c57e68" containerName="main" containerID="cri-o://204d9e2a567cc9c6dd9d679cd7d7083661df2299087078919a3662aaa3b7c54e" gracePeriod=45
Sep 18 17:33:53.526290 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.526259    2584 generic.go:356] "Generic (PLEG): container finished" podID="6dba3b10-f411-4420-b773-ed2f52c57e68" containerID="204d9e2a567cc9c6dd9d679cd7d7083661df2299087078919a3662aaa3b7c54e" exitCode=0
Sep 18 17:33:53.526456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.526333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" event={"ID":"6dba3b10-f411-4420-b773-ed2f52c57e68","Type":"ContainerDied","Data":"204d9e2a567cc9c6dd9d679cd7d7083661df2299087078919a3662aaa3b7c54e"}
Sep 18 17:33:53.568988 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.568937    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:33:53.604508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604478    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604524    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604546    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604572    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604595    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fn6mg\" (UniqueName: \"kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604624    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm\") pod \"6dba3b10-f411-4420-b773-ed2f52c57e68\" (UID: \"6dba3b10-f411-4420-b773-ed2f52c57e68\") "
Sep 18 17:33:53.604972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604799    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:33:53.604972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604790    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache" (OuterVolumeSpecName: "model-cache") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:33:53.604972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604875    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home" (OuterVolumeSpecName: "home") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:33:53.604972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604947    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:53.604972 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.604968    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:53.607086 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.607059    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg" (OuterVolumeSpecName: "kube-api-access-fn6mg") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "kube-api-access-fn6mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:33:53.607384 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.607355    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:33:53.607462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.607445    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm" (OuterVolumeSpecName: "dshm") pod "6dba3b10-f411-4420-b773-ed2f52c57e68" (UID: "6dba3b10-f411-4420-b773-ed2f52c57e68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:33:53.705959 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.705927    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dba3b10-f411-4420-b773-ed2f52c57e68-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:53.705959 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.705953    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:53.705959 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.705962    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fn6mg\" (UniqueName: \"kubernetes.io/projected/6dba3b10-f411-4420-b773-ed2f52c57e68-kube-api-access-fn6mg\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:53.706241 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:53.705971    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dba3b10-f411-4420-b773-ed2f52c57e68-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:33:54.533150 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:54.533097    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"
Sep 18 17:33:54.533552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:54.533145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr" event={"ID":"6dba3b10-f411-4420-b773-ed2f52c57e68","Type":"ContainerDied","Data":"e0d5c5e3be151b65412b98b93bc90b22230dba76963c119f8fe595b7514f904f"}
Sep 18 17:33:54.533552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:54.533200    2584 scope.go:117] "RemoveContainer" containerID="204d9e2a567cc9c6dd9d679cd7d7083661df2299087078919a3662aaa3b7c54e"
Sep 18 17:33:54.557040 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:54.557003    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:33:54.562839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:54.562814    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2aa65a/test-model-2aa65a-kserve-6b5495c449-vzxsr"]
Sep 18 17:33:56.556824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:33:56.556788    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dba3b10-f411-4420-b773-ed2f52c57e68" path="/var/lib/kubelet/pods/6dba3b10-f411-4420-b773-ed2f52c57e68/volumes"
Sep 18 17:34:01.500436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500401    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:34:01.500847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500814    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dba3b10-f411-4420-b773-ed2f52c57e68" containerName="main"
Sep 18 17:34:01.500847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500828    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dba3b10-f411-4420-b773-ed2f52c57e68" containerName="main"
Sep 18 17:34:01.500847 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500846    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerName="payload-processing"
Sep 18 17:34:01.500954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500852    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerName="payload-processing"
Sep 18 17:34:01.500954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500916    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dba3b10-f411-4420-b773-ed2f52c57e68" containerName="main"
Sep 18 17:34:01.500954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.500928    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f2c3a36-895f-4f42-ae3d-a43472410b09" containerName="payload-processing"
Sep 18 17:34:01.505493 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.505476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.508354 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.508336    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"e2e-conflict-b-b4eda83d-kserve-self-signed-certs\""
Sep 18 17:34:01.513290 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.513138    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:34:01.579488 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579456    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.579641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6xph\" (UniqueName: \"kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.579641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.579762 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.579762 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.579863 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.579762    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681127 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6xph\" (UniqueName: \"kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681291 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681218    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681480 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681480 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681585 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681674 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681644    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.681792 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.681685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.683650 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.683626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.683898 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.683880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.706518 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.706494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6xph\" (UniqueName: \"kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph\") pod \"e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") " pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:01.816383 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:01.816299    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:02.118692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:02.118662    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:34:02.119706 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:34:02.119682    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf566bffc_c2f7_49c5_a05a_4134228515e6.slice/crio-b592366ab62c29fd4353274970610de05c481fd3be4045157a11af4a660340c4 WatchSource:0}: Error finding container b592366ab62c29fd4353274970610de05c481fd3be4045157a11af4a660340c4: Status 404 returned error can't find the container with id b592366ab62c29fd4353274970610de05c481fd3be4045157a11af4a660340c4
Sep 18 17:34:02.582138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:02.582029    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" event={"ID":"f566bffc-c2f7-49c5-a05a-4134228515e6","Type":"ContainerStarted","Data":"286cbb1a696d5406b114607ef342b4812e73ba660b9927be53064ae87c29e9ca"}
Sep 18 17:34:02.582138 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:02.582074    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" event={"ID":"f566bffc-c2f7-49c5-a05a-4134228515e6","Type":"ContainerStarted","Data":"b592366ab62c29fd4353274970610de05c481fd3be4045157a11af4a660340c4"}
Sep 18 17:34:02.627219 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:02.627162    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" podStartSLOduration=1.6271474160000001 podStartE2EDuration="1.627147416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:34:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:34:02.625602494 +0000 UTC m=+1174.567860102" watchObservedRunningTime="2026-09-18 17:34:02.627147416 +0000 UTC m=+1174.569405024"
Sep 18 17:34:04.486288 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.486248    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:34:04.490094 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.490067    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.492537 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.492511    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b68d6946\""
Sep 18 17:34:04.500589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.500559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:34:04.611363 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.611327    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgcp6\" (UniqueName: \"kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.611594 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.611481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.712462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.712422    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.712671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.712504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcp6\" (UniqueName: \"kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.713189 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.713169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.722016 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.721978    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgcp6\" (UniqueName: \"kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6\") pod \"payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:04.803365 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:04.803257    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:05.088270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.088231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:34:05.090472 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:34:05.090430    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08cb3368_cc6c_40fc_ae45_64c0839b0933.slice/crio-99a191105a5b14bfb34794d9a83aa17734a7a3cd0c258e98eb4d9f0ec60c7c14 WatchSource:0}: Error finding container 99a191105a5b14bfb34794d9a83aa17734a7a3cd0c258e98eb4d9f0ec60c7c14: Status 404 returned error can't find the container with id 99a191105a5b14bfb34794d9a83aa17734a7a3cd0c258e98eb4d9f0ec60c7c14
Sep 18 17:34:05.485909 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.485861    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:34:05.490220 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.490140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.492869 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.492835    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-eeab6e-dockercfg-rddmm\""
Sep 18 17:34:05.493026 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.492835    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-eeab6e\""
Sep 18 17:34:05.497522 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.497459    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:34:05.602990 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.602950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" event={"ID":"08cb3368-cc6c-40fc-ae45-64c0839b0933","Type":"ContainerStarted","Data":"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"}
Sep 18 17:34:05.603204 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.603006    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" event={"ID":"08cb3368-cc6c-40fc-ae45-64c0839b0933","Type":"ContainerStarted","Data":"99a191105a5b14bfb34794d9a83aa17734a7a3cd0c258e98eb4d9f0ec60c7c14"}
Sep 18 17:34:05.603204 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.603029    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:05.622192 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.622154    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.622377 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.622197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wtqc\" (UniqueName: \"kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.626736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.626664    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" podStartSLOduration=1.626640218 podStartE2EDuration="1.626640218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:34:05.624175722 +0000 UTC m=+1177.566433331" watchObservedRunningTime="2026-09-18 17:34:05.626640218 +0000 UTC m=+1177.568897828"
Sep 18 17:34:05.723368 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.723326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.723552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.723375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wtqc\" (UniqueName: \"kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.724094 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.724073    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.732039 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.732001    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wtqc\" (UniqueName: \"kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc\") pod \"payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:05.805864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:05.805764    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:06.085874 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:06.085778    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:34:06.088907 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:34:06.088875    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc260257c_14e8_4c4c_814e_15e58d956edf.slice/crio-bbe5013f99d4ddc264c2962e5bc6256e54cae9d5e8e146572b5d934f5f47129f WatchSource:0}: Error finding container bbe5013f99d4ddc264c2962e5bc6256e54cae9d5e8e146572b5d934f5f47129f: Status 404 returned error can't find the container with id bbe5013f99d4ddc264c2962e5bc6256e54cae9d5e8e146572b5d934f5f47129f
Sep 18 17:34:06.610064 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:06.610019    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" event={"ID":"c260257c-14e8-4c4c-814e-15e58d956edf","Type":"ContainerStarted","Data":"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"}
Sep 18 17:34:06.610492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:06.610090    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" event={"ID":"c260257c-14e8-4c4c-814e-15e58d956edf","Type":"ContainerStarted","Data":"bbe5013f99d4ddc264c2962e5bc6256e54cae9d5e8e146572b5d934f5f47129f"}
Sep 18 17:34:06.610492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:06.610140    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:06.640128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:06.640047    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" podStartSLOduration=1.640028826 podStartE2EDuration="1.640028826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:34:06.639251114 +0000 UTC m=+1178.581508740" watchObservedRunningTime="2026-09-18 17:34:06.640028826 +0000 UTC m=+1178.582286436"
Sep 18 17:34:11.816939 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:11.816901    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:11.817419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:11.817165    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:11.829604 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:11.829582    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:12.661133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:12.661089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:34:16.613206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:16.613180    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:34:17.617584 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:17.617557    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:34:28.590359 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:28.590330    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:34:28.594397 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:28.594380    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:34:44.092437 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.092403    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:34:44.097547 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.097529    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.100621 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.100597    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-808470-dockercfg-cjqwl\""
Sep 18 17:34:44.100873 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.100858    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-808470\""
Sep 18 17:34:44.108722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.108698    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:34:44.141050 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.141019    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:34:44.144565 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.144547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.155554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.155532    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:34:44.180551 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.180515    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.180770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.180560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8cp2\" (UniqueName: \"kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.180770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.180598    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drxl5\" (UniqueName: \"kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.180770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.180639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.282365 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.282326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.282365 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.282364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8cp2\" (UniqueName: \"kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.282655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.282501    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drxl5\" (UniqueName: \"kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.282655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.282569    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.283133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.283082    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.283252 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.283235    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.291660 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.291625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drxl5\" (UniqueName: \"kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5\") pod \"payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.291775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.291761    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8cp2\" (UniqueName: \"kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2\") pod \"payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.408446 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.408410    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.454875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.454844    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.690587 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.690559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:34:44.691896 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:34:44.691871    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29bf793_a5e9_4d60_a005_28a42898b80b.slice/crio-03f7ef040013f2413463899040e3c76aca33949ada6e1e728049ac00590f6a1e WatchSource:0}: Error finding container 03f7ef040013f2413463899040e3c76aca33949ada6e1e728049ac00590f6a1e: Status 404 returned error can't find the container with id 03f7ef040013f2413463899040e3c76aca33949ada6e1e728049ac00590f6a1e
Sep 18 17:34:44.738955 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.738928    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:34:44.739748 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:34:44.739719    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b0b474_5307_47c5_ac17_e162003fd599.slice/crio-35c6dac2c576158d4a21bb0ecdbe22e4ebc362a8c14cb1a8f4fc17b27dc9ca9a WatchSource:0}: Error finding container 35c6dac2c576158d4a21bb0ecdbe22e4ebc362a8c14cb1a8f4fc17b27dc9ca9a: Status 404 returned error can't find the container with id 35c6dac2c576158d4a21bb0ecdbe22e4ebc362a8c14cb1a8f4fc17b27dc9ca9a
Sep 18 17:34:44.843059 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.843017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" event={"ID":"b7b0b474-5307-47c5-ac17-e162003fd599","Type":"ContainerStarted","Data":"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"}
Sep 18 17:34:44.843270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.843089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" event={"ID":"b7b0b474-5307-47c5-ac17-e162003fd599","Type":"ContainerStarted","Data":"35c6dac2c576158d4a21bb0ecdbe22e4ebc362a8c14cb1a8f4fc17b27dc9ca9a"}
Sep 18 17:34:44.843398 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.843373    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:34:44.844892 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.844867    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" event={"ID":"a29bf793-a5e9-4d60-a005-28a42898b80b","Type":"ContainerStarted","Data":"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"}
Sep 18 17:34:44.845025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.844913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" event={"ID":"a29bf793-a5e9-4d60-a005-28a42898b80b","Type":"ContainerStarted","Data":"03f7ef040013f2413463899040e3c76aca33949ada6e1e728049ac00590f6a1e"}
Sep 18 17:34:44.845025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.844998    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:44.863669 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.863625    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" podStartSLOduration=0.863608621 podStartE2EDuration="863.608621ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:34:44.861653446 +0000 UTC m=+1216.803911057" watchObservedRunningTime="2026-09-18 17:34:44.863608621 +0000 UTC m=+1216.805866278"
Sep 18 17:34:44.885121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:44.885055    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" podStartSLOduration=0.885039175 podStartE2EDuration="885.039175ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:34:44.883165552 +0000 UTC m=+1216.825423162" watchObservedRunningTime="2026-09-18 17:34:44.885039175 +0000 UTC m=+1216.827296784"
Sep 18 17:34:55.852328 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:55.852288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:34:55.852753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:34:55.852663    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:35:55.111705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:35:55.111670    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:36:10.133962 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.133916    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" podUID="f566bffc-c2f7-49c5-a05a-4134228515e6" containerName="main" containerID="cri-o://286cbb1a696d5406b114607ef342b4812e73ba660b9927be53064ae87c29e9ca" gracePeriod=45
Sep 18 17:36:10.369758 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.369723    2584 generic.go:356] "Generic (PLEG): container finished" podID="f566bffc-c2f7-49c5-a05a-4134228515e6" containerID="286cbb1a696d5406b114607ef342b4812e73ba660b9927be53064ae87c29e9ca" exitCode=0
Sep 18 17:36:10.369945 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.369800    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" event={"ID":"f566bffc-c2f7-49c5-a05a-4134228515e6","Type":"ContainerDied","Data":"286cbb1a696d5406b114607ef342b4812e73ba660b9927be53064ae87c29e9ca"}
Sep 18 17:36:10.398005 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.397932    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:36:10.553384 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553355    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6xph\" (UniqueName: \"kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553512    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553544    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553589 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553564    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553627    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache\") pod \"f566bffc-c2f7-49c5-a05a-4134228515e6\" (UID: \"f566bffc-c2f7-49c5-a05a-4134228515e6\") "
Sep 18 17:36:10.553841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553810    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:10.553958 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.553845    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home" (OuterVolumeSpecName: "home") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:10.554078 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.554007    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:10.554078 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.554011    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:10.554078 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.554037    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:10.555935 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.555906    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm" (OuterVolumeSpecName: "dshm") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:10.556044 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.555946    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:36:10.556091 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.556043    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph" (OuterVolumeSpecName: "kube-api-access-z6xph") pod "f566bffc-c2f7-49c5-a05a-4134228515e6" (UID: "f566bffc-c2f7-49c5-a05a-4134228515e6"). InnerVolumeSpecName "kube-api-access-z6xph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:36:10.654984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.654754    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6xph\" (UniqueName: \"kubernetes.io/projected/f566bffc-c2f7-49c5-a05a-4134228515e6-kube-api-access-z6xph\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:10.654984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.654790    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:10.654984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.654806    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f566bffc-c2f7-49c5-a05a-4134228515e6-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:10.654984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:10.654822    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f566bffc-c2f7-49c5-a05a-4134228515e6-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:11.381467 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:11.381423    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr" event={"ID":"f566bffc-c2f7-49c5-a05a-4134228515e6","Type":"ContainerDied","Data":"b592366ab62c29fd4353274970610de05c481fd3be4045157a11af4a660340c4"}
Sep 18 17:36:11.381980 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:11.381498    2584 scope.go:117] "RemoveContainer" containerID="286cbb1a696d5406b114607ef342b4812e73ba660b9927be53064ae87c29e9ca"
Sep 18 17:36:11.381980 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:11.381437    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"
Sep 18 17:36:11.402648 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:11.402614    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:36:11.406244 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:11.406217    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-b-b4eda83d-kserve-86ffb45fb-7fjvr"]
Sep 18 17:36:12.556983 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:12.556938    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f566bffc-c2f7-49c5-a05a-4134228515e6" path="/var/lib/kubelet/pods/f566bffc-c2f7-49c5-a05a-4134228515e6/volumes"
Sep 18 17:36:40.562885 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:40.562849    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:36:52.054614 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.054230    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:36:52.054614 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.054508    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" podUID="08cb3368-cc6c-40fc-ae45-64c0839b0933" containerName="payload-pre-processing" containerID="cri-o://439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39" gracePeriod=30
Sep 18 17:36:52.330962 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.330934    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:36:52.471558 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.471520    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgcp6\" (UniqueName: \"kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6\") pod \"08cb3368-cc6c-40fc-ae45-64c0839b0933\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") "
Sep 18 17:36:52.471739 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.471617    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume\") pod \"08cb3368-cc6c-40fc-ae45-64c0839b0933\" (UID: \"08cb3368-cc6c-40fc-ae45-64c0839b0933\") "
Sep 18 17:36:52.471979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.471951    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08cb3368-cc6c-40fc-ae45-64c0839b0933" (UID: "08cb3368-cc6c-40fc-ae45-64c0839b0933"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:36:52.473986 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.473962    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6" (OuterVolumeSpecName: "kube-api-access-fgcp6") pod "08cb3368-cc6c-40fc-ae45-64c0839b0933" (UID: "08cb3368-cc6c-40fc-ae45-64c0839b0933"). InnerVolumeSpecName "kube-api-access-fgcp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:36:52.572421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.572398    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgcp6\" (UniqueName: \"kubernetes.io/projected/08cb3368-cc6c-40fc-ae45-64c0839b0933-kube-api-access-fgcp6\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:52.572421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.572422    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08cb3368-cc6c-40fc-ae45-64c0839b0933-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:52.628888 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.628853    2584 generic.go:356] "Generic (PLEG): container finished" podID="08cb3368-cc6c-40fc-ae45-64c0839b0933" containerID="439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39" exitCode=0
Sep 18 17:36:52.629071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.628896    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"
Sep 18 17:36:52.629071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.628933    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" event={"ID":"08cb3368-cc6c-40fc-ae45-64c0839b0933","Type":"ContainerDied","Data":"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"}
Sep 18 17:36:52.629071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.628981    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l" event={"ID":"08cb3368-cc6c-40fc-ae45-64c0839b0933","Type":"ContainerDied","Data":"99a191105a5b14bfb34794d9a83aa17734a7a3cd0c258e98eb4d9f0ec60c7c14"}
Sep 18 17:36:52.629071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.629004    2584 scope.go:117] "RemoveContainer" containerID="439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"
Sep 18 17:36:52.641296 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.641275    2584 scope.go:117] "RemoveContainer" containerID="439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"
Sep 18 17:36:52.641682 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:36:52.641655    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39\": container with ID starting with 439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39 not found: ID does not exist" containerID="439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"
Sep 18 17:36:52.641741 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.641695    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39"} err="failed to get container status \"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39\": rpc error: code = NotFound desc = could not find container \"439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39\": container with ID starting with 439195d8e783d31d63c37283a6670b3e06ad0abd51b2244dd6421394903deb39 not found: ID does not exist"
Sep 18 17:36:52.651332 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.651292    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:36:52.656299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:52.656267    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b68d6946-5dddd9d5d-ngg8l"]
Sep 18 17:36:54.557816 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:54.557771    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08cb3368-cc6c-40fc-ae45-64c0839b0933" path="/var/lib/kubelet/pods/08cb3368-cc6c-40fc-ae45-64c0839b0933/volumes"
Sep 18 17:36:55.583163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:55.583092    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" podUID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" containerName="main" containerID="cri-o://19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0" gracePeriod=45
Sep 18 17:36:55.854491 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:55.854465    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:36:56.008121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008191    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008216    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008246    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008292 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008272    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008304    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm592\" (UniqueName: \"kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592\") pod \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\" (UID: \"2e2a3461-8760-4bab-b95e-b33bb60b96d7\") "
Sep 18 17:36:56.008552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008399    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:56.008552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008438    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:56.008552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008531    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home" (OuterVolumeSpecName: "home") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:56.008750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008657    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.008750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008676    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.008750 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.008689    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.010691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.010669    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm" (OuterVolumeSpecName: "dshm") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:36:56.010769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.010697    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:36:56.010769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.010744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592" (OuterVolumeSpecName: "kube-api-access-nm592") pod "2e2a3461-8760-4bab-b95e-b33bb60b96d7" (UID: "2e2a3461-8760-4bab-b95e-b33bb60b96d7"). InnerVolumeSpecName "kube-api-access-nm592". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:36:56.109364 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.109322    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm592\" (UniqueName: \"kubernetes.io/projected/2e2a3461-8760-4bab-b95e-b33bb60b96d7-kube-api-access-nm592\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.109364 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.109357    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e2a3461-8760-4bab-b95e-b33bb60b96d7-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.109364 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.109368    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2a3461-8760-4bab-b95e-b33bb60b96d7-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:36:56.655071 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.655035    2584 generic.go:356] "Generic (PLEG): container finished" podID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" containerID="19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0" exitCode=0
Sep 18 17:36:56.655596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.655087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" event={"ID":"2e2a3461-8760-4bab-b95e-b33bb60b96d7","Type":"ContainerDied","Data":"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"}
Sep 18 17:36:56.655596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.655090    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"
Sep 18 17:36:56.655596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.655135    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn" event={"ID":"2e2a3461-8760-4bab-b95e-b33bb60b96d7","Type":"ContainerDied","Data":"36ddeb974ce0074964348236daa7b449fadc84d5461891991156ed5723f1ca5e"}
Sep 18 17:36:56.655596 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.655151    2584 scope.go:117] "RemoveContainer" containerID="19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"
Sep 18 17:36:56.664738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.664721    2584 scope.go:117] "RemoveContainer" containerID="19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"
Sep 18 17:36:56.664991 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:36:56.664972    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0\": container with ID starting with 19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0 not found: ID does not exist" containerID="19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"
Sep 18 17:36:56.665048 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.664997    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0"} err="failed to get container status \"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0\": rpc error: code = NotFound desc = could not find container \"19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0\": container with ID starting with 19f1d0293cb073518ed4a68a9d02b9e1555d98156f2d25d20bee62342645c5b0 not found: ID does not exist"
Sep 18 17:36:56.676890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.676858    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:36:56.681996 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:56.681975    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/e2e-conflict-a-b4eda83d-kserve-6d6bd46bd6-mrnpn"]
Sep 18 17:36:58.526017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.525978    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526395    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f566bffc-c2f7-49c5-a05a-4134228515e6" containerName="main"
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526408    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f566bffc-c2f7-49c5-a05a-4134228515e6" containerName="main"
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526419    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08cb3368-cc6c-40fc-ae45-64c0839b0933" containerName="payload-pre-processing"
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526425    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="08cb3368-cc6c-40fc-ae45-64c0839b0933" containerName="payload-pre-processing"
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526441    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" containerName="main"
Sep 18 17:36:58.526474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526447    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" containerName="main"
Sep 18 17:36:58.526692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526554    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" containerName="main"
Sep 18 17:36:58.526692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526564    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="08cb3368-cc6c-40fc-ae45-64c0839b0933" containerName="payload-pre-processing"
Sep 18 17:36:58.526692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.526571    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f566bffc-c2f7-49c5-a05a-4134228515e6" containerName="main"
Sep 18 17:36:58.531020 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.530990    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.535192 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.535167    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"openshift-service-ca.crt\""
Sep 18 17:36:58.535341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.535219    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"kube-root-ca.crt\""
Sep 18 17:36:58.535341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.535177    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"default-dockercfg-r86nm\""
Sep 18 17:36:58.535341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.535298    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5b6d69\"/\"distinct-w4-5b6d69-kserve-self-signed-certs\""
Sep 18 17:36:58.564708 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.564649    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2a3461-8760-4bab-b95e-b33bb60b96d7" path="/var/lib/kubelet/pods/2e2a3461-8760-4bab-b95e-b33bb60b96d7/volumes"
Sep 18 17:36:58.565085 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.565065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:36:58.633405 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clpmt\" (UniqueName: \"kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.633561 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.633561 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.633561 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.633701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.633701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.633620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.734984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.734934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clpmt\" (UniqueName: \"kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735042    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735700 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.735749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.735689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.737752 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.737724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.737926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.737907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.744458 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.744435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clpmt\" (UniqueName: \"kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt\") pod \"distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") " pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:58.840414 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:58.840312    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:36:59.127206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:59.127178    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:36:59.128406 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:36:59.128383    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14446f7d_9fa9_4fe4_a963_eeef661ba891.slice/crio-710556d4984f527c6b276d47a1ad2ff877cdb8ffaa2c6fc391c592a32cff8892 WatchSource:0}: Error finding container 710556d4984f527c6b276d47a1ad2ff877cdb8ffaa2c6fc391c592a32cff8892: Status 404 returned error can't find the container with id 710556d4984f527c6b276d47a1ad2ff877cdb8ffaa2c6fc391c592a32cff8892
Sep 18 17:36:59.675216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:59.675179    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" event={"ID":"14446f7d-9fa9-4fe4-a963-eeef661ba891","Type":"ContainerStarted","Data":"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"}
Sep 18 17:36:59.675689 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:59.675223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" event={"ID":"14446f7d-9fa9-4fe4-a963-eeef661ba891","Type":"ContainerStarted","Data":"710556d4984f527c6b276d47a1ad2ff877cdb8ffaa2c6fc391c592a32cff8892"}
Sep 18 17:36:59.695065 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:36:59.695009    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" podStartSLOduration=1.694993172 podStartE2EDuration="1.694993172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:36:59.694066919 +0000 UTC m=+1351.636324540" watchObservedRunningTime="2026-09-18 17:36:59.694993172 +0000 UTC m=+1351.637250780"
Sep 18 17:37:08.841076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:08.841021    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:37:08.841076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:08.841088    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:37:08.854222 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:08.854190    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:37:09.747479 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:09.747443    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:37:54.714307 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.714267    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:37:54.722155 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.720996    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.724030 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.724007    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0a2e13\"/\"embedding-w0-0a2e13-kserve-self-signed-certs\""
Sep 18 17:37:54.728337 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.728276    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:37:54.783536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783503    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.783701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783587    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.783701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.783701 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.783824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grz9z\" (UniqueName: \"kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.783824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.783777    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884412 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884375    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grz9z\" (UniqueName: \"kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884622 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884650    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884793 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884917 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884897    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.884985 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.884962    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.885044 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.885018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.886896 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.886876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.887161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.887143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:54.893749 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:54.893726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grz9z\" (UniqueName: \"kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z\") pod \"embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") " pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:55.032677 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:55.032594    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:37:55.311895 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:55.311863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:37:55.312976 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:37:55.312951    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34ce9ea9_abc1_45ca_8b0e_bd745a699c6e.slice/crio-af27321ec83cc8ed9fd6082bf822e47c8252972be6053597cef6111854d335d9 WatchSource:0}: Error finding container af27321ec83cc8ed9fd6082bf822e47c8252972be6053597cef6111854d335d9: Status 404 returned error can't find the container with id af27321ec83cc8ed9fd6082bf822e47c8252972be6053597cef6111854d335d9
Sep 18 17:37:56.011671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:56.011633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" event={"ID":"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e","Type":"ContainerStarted","Data":"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"}
Sep 18 17:37:56.011671 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:56.011675    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" event={"ID":"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e","Type":"ContainerStarted","Data":"af27321ec83cc8ed9fd6082bf822e47c8252972be6053597cef6111854d335d9"}
Sep 18 17:37:56.032206 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:37:56.032159    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" podStartSLOduration=2.032141788 podStartE2EDuration="2.032141788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:37:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:37:56.029396563 +0000 UTC m=+1407.971654174" watchObservedRunningTime="2026-09-18 17:37:56.032141788 +0000 UTC m=+1407.974399395"
Sep 18 17:38:05.032845 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:05.032804    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:38:05.033392 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:05.032861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:38:05.052383 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:05.052352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:38:05.076420 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:05.076387    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:38:53.696839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.696790    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:38:53.700441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.700420    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.703161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.703139    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-9c0254-dockercfg-knq4b\""
Sep 18 17:38:53.703275 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.703197    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-9c0254\""
Sep 18 17:38:53.712688 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.712662    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:38:53.716818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.716800    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:38:53.716910 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.716885    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.724940 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.724918    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:38:53.786164 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.786124    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8wd\" (UniqueName: \"kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.786361 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.786231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjkjv\" (UniqueName: \"kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.786361 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.786261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.786361 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.786326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.887685 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.887652    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.887887 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.887727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8wd\" (UniqueName: \"kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.887887 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.887781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjkjv\" (UniqueName: \"kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.887887 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.887805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.888468 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.888445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:53.888536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.888488    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.896393 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.896365    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjkjv\" (UniqueName: \"kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv\") pod \"payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") " pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:53.896736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:53.896715    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8wd\" (UniqueName: \"kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd\") pod \"payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:54.013024 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.012936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:54.030376 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.030351    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:54.295925 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.295897    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:38:54.297117 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:38:54.297073    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ec2d77_aab8_42a5_9073_5137f78da20e.slice/crio-3c9d4d8b5bad650a68e847c3899f13f9719241bb5d29f8b1e63c579aa1ec7152 WatchSource:0}: Error finding container 3c9d4d8b5bad650a68e847c3899f13f9719241bb5d29f8b1e63c579aa1ec7152: Status 404 returned error can't find the container with id 3c9d4d8b5bad650a68e847c3899f13f9719241bb5d29f8b1e63c579aa1ec7152
Sep 18 17:38:54.323640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.323614    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:38:54.327398 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:38:54.327368    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5e7400_4da2_4562_ada2_142d6bc90c48.slice/crio-f1736d9cfb1b7044f0f0e60777fcb87c5d1d5f48c53cde738403797c2d286a04 WatchSource:0}: Error finding container f1736d9cfb1b7044f0f0e60777fcb87c5d1d5f48c53cde738403797c2d286a04: Status 404 returned error can't find the container with id f1736d9cfb1b7044f0f0e60777fcb87c5d1d5f48c53cde738403797c2d286a04
Sep 18 17:38:54.349223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.349153    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" event={"ID":"0c5e7400-4da2-4562-ada2-142d6bc90c48","Type":"ContainerStarted","Data":"f1736d9cfb1b7044f0f0e60777fcb87c5d1d5f48c53cde738403797c2d286a04"}
Sep 18 17:38:54.350826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:54.350795    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" event={"ID":"56ec2d77-aab8-42a5-9073-5137f78da20e","Type":"ContainerStarted","Data":"3c9d4d8b5bad650a68e847c3899f13f9719241bb5d29f8b1e63c579aa1ec7152"}
Sep 18 17:38:55.369307 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.369264    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" event={"ID":"0c5e7400-4da2-4562-ada2-142d6bc90c48","Type":"ContainerStarted","Data":"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"}
Sep 18 17:38:55.369817 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.369488    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:38:55.371330 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.371291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" event={"ID":"56ec2d77-aab8-42a5-9073-5137f78da20e","Type":"ContainerStarted","Data":"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"}
Sep 18 17:38:55.371478 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.371352    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:38:55.391356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.391296    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" podStartSLOduration=2.391281071 podStartE2EDuration="2.391281071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:38:55.390329928 +0000 UTC m=+1467.332587537" watchObservedRunningTime="2026-09-18 17:38:55.391281071 +0000 UTC m=+1467.333538680"
Sep 18 17:38:55.408204 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:38:55.408149    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" podStartSLOduration=2.408130804 podStartE2EDuration="2.408130804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:38:55.407021751 +0000 UTC m=+1467.349279364" watchObservedRunningTime="2026-09-18 17:38:55.408130804 +0000 UTC m=+1467.350388413"
Sep 18 17:39:06.380534 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:06.380502    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:39:06.381030 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:06.380587    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:39:28.646840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:28.646811    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:39:28.651499 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:28.651476    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:39:44.194818 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:44.194780    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:39:44.203363 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:44.203331    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:39:59.215640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.215549    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" podUID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" containerName="main" containerID="cri-o://5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d" gracePeriod=45
Sep 18 17:39:59.228511 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.228477    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" podUID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" containerName="main" containerID="cri-o://a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f" gracePeriod=45
Sep 18 17:39:59.389203 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.389165    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:39:59.389716 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.389660    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" podUID="df525e37-9334-445d-aa4b-b9ab59bfa3af" containerName="maas-api" containerID="cri-o://1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1" gracePeriod=30
Sep 18 17:39:59.547536 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.547506    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:39:59.550658 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.550627    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:39:59.566067 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.565993    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.566259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk44g\" (UniqueName: \"kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566175    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.566259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566208    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566232    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566260    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.566504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566424    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm\") pod \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\" (UID: \"d67df7b8-6b70-4d5f-9172-bcb0147262f6\") "
Sep 18 17:39:59.566725 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566528    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grz9z\" (UniqueName: \"kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.566725 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566585    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.566725 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566601    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home" (OuterVolumeSpecName: "home") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.566942 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566832    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home" (OuterVolumeSpecName: "home") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.566942 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.566611    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home\") pod \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\" (UID: \"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e\") "
Sep 18 17:39:59.567062 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.567028    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.567429 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.567400    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.567429 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.567424    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.567764 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.567681    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.568351 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568327    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.568451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568356    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.568451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568370    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.568451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568381    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.568451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568393    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.568451 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.568404    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.571785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.571759    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm" (OuterVolumeSpecName: "dshm") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.571785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.571772    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g" (OuterVolumeSpecName: "kube-api-access-kk44g") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "kube-api-access-kk44g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:39:59.571941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.571765    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:59.571941 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.571905    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z" (OuterVolumeSpecName: "kube-api-access-grz9z") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "kube-api-access-grz9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:39:59.572287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.572256    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm" (OuterVolumeSpecName: "dshm") pod "d67df7b8-6b70-4d5f-9172-bcb0147262f6" (UID: "d67df7b8-6b70-4d5f-9172-bcb0147262f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:39:59.572287 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.572257    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" (UID: "34ce9ea9-abc1-45ca-8b0e-bd745a699c6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:59.669022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.668990    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.669022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.669016    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk44g\" (UniqueName: \"kubernetes.io/projected/d67df7b8-6b70-4d5f-9172-bcb0147262f6-kube-api-access-kk44g\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.669022 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.669025    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67df7b8-6b70-4d5f-9172-bcb0147262f6-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.669274 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.669035    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67df7b8-6b70-4d5f-9172-bcb0147262f6-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.669274 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.669044    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grz9z\" (UniqueName: \"kubernetes.io/projected/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-kube-api-access-grz9z\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.669274 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.669054    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.670441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.670418    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:39:59.765271 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.765179    2584 generic.go:356] "Generic (PLEG): container finished" podID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" containerID="a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f" exitCode=0
Sep 18 17:39:59.765271 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.765237    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"
Sep 18 17:39:59.765512 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.765265    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" event={"ID":"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e","Type":"ContainerDied","Data":"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"}
Sep 18 17:39:59.765512 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.765315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf" event={"ID":"34ce9ea9-abc1-45ca-8b0e-bd745a699c6e","Type":"ContainerDied","Data":"af27321ec83cc8ed9fd6082bf822e47c8252972be6053597cef6111854d335d9"}
Sep 18 17:39:59.765512 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.765338    2584 scope.go:117] "RemoveContainer" containerID="a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"
Sep 18 17:39:59.767239 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.767208    2584 generic.go:356] "Generic (PLEG): container finished" podID="df525e37-9334-445d-aa4b-b9ab59bfa3af" containerID="1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1" exitCode=0
Sep 18 17:39:59.767356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.767337    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" event={"ID":"df525e37-9334-445d-aa4b-b9ab59bfa3af","Type":"ContainerDied","Data":"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"}
Sep 18 17:39:59.767407 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.767388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh" event={"ID":"df525e37-9334-445d-aa4b-b9ab59bfa3af","Type":"ContainerDied","Data":"1b80b9da69a05c56075c335528e38c3f81e340bf657ff054554b3f655668b5bd"}
Sep 18 17:39:59.767464 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.767432    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"
Sep 18 17:39:59.769226 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769202    2584 generic.go:356] "Generic (PLEG): container finished" podID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" containerID="5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d" exitCode=0
Sep 18 17:39:59.769344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769305    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" event={"ID":"d67df7b8-6b70-4d5f-9172-bcb0147262f6","Type":"ContainerDied","Data":"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"}
Sep 18 17:39:59.769344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769335    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb" event={"ID":"d67df7b8-6b70-4d5f-9172-bcb0147262f6","Type":"ContainerDied","Data":"9b24694c346ebbbcf677cf077768c7d8e916e5fda9283386682b82c1b24c3d03"}
Sep 18 17:39:59.769436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769415    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca\") pod \"df525e37-9334-445d-aa4b-b9ab59bfa3af\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") "
Sep 18 17:39:59.769502 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769486    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sp7q5\" (UniqueName: \"kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5\") pod \"df525e37-9334-445d-aa4b-b9ab59bfa3af\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") "
Sep 18 17:39:59.769582 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769567    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs\") pod \"df525e37-9334-445d-aa4b-b9ab59bfa3af\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") "
Sep 18 17:39:59.769641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769626    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls\") pod \"df525e37-9334-445d-aa4b-b9ab59bfa3af\" (UID: \"df525e37-9334-445d-aa4b-b9ab59bfa3af\") "
Sep 18 17:39:59.769796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769776    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df525e37-9334-445d-aa4b-b9ab59bfa3af" (UID: "df525e37-9334-445d-aa4b-b9ab59bfa3af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:39:59.769939 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.769920    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df525e37-9334-445d-aa4b-b9ab59bfa3af-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.770211 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.770193    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"
Sep 18 17:39:59.772653 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.772620    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5" (OuterVolumeSpecName: "kube-api-access-sp7q5") pod "df525e37-9334-445d-aa4b-b9ab59bfa3af" (UID: "df525e37-9334-445d-aa4b-b9ab59bfa3af"). InnerVolumeSpecName "kube-api-access-sp7q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:39:59.772769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.772749    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "df525e37-9334-445d-aa4b-b9ab59bfa3af" (UID: "df525e37-9334-445d-aa4b-b9ab59bfa3af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:59.772834 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.772780    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df525e37-9334-445d-aa4b-b9ab59bfa3af" (UID: "df525e37-9334-445d-aa4b-b9ab59bfa3af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:39:59.776966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.776948    2584 scope.go:117] "RemoveContainer" containerID="a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"
Sep 18 17:39:59.777371 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:39:59.777350    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f\": container with ID starting with a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f not found: ID does not exist" containerID="a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"
Sep 18 17:39:59.777427 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.777383    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f"} err="failed to get container status \"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f\": rpc error: code = NotFound desc = could not find container \"a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f\": container with ID starting with a29a9ce562739e9af5492f2d7a792dbd11deefdcfefc2ab67d0172470894339f not found: ID does not exist"
Sep 18 17:39:59.777427 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.777409    2584 scope.go:117] "RemoveContainer" containerID="1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"
Sep 18 17:39:59.786270 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.786247    2584 scope.go:117] "RemoveContainer" containerID="1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"
Sep 18 17:39:59.786566 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:39:59.786549    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1\": container with ID starting with 1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1 not found: ID does not exist" containerID="1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"
Sep 18 17:39:59.786650 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.786577    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1"} err="failed to get container status \"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1\": rpc error: code = NotFound desc = could not find container \"1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1\": container with ID starting with 1469d5107392f582262c9f1d18a4bf434178970a778dd9a69c2c6709b7db2cd1 not found: ID does not exist"
Sep 18 17:39:59.786650 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.786600    2584 scope.go:117] "RemoveContainer" containerID="5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"
Sep 18 17:39:59.795436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.795420    2584 scope.go:117] "RemoveContainer" containerID="5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"
Sep 18 17:39:59.795700 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:39:59.795685    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d\": container with ID starting with 5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d not found: ID does not exist" containerID="5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"
Sep 18 17:39:59.795753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.795712    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d"} err="failed to get container status \"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d\": rpc error: code = NotFound desc = could not find container \"5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d\": container with ID starting with 5b1fd1e29daba48214679773247789a0c5aade3b3a09360a8c66ca1cbbc2e13d not found: ID does not exist"
Sep 18 17:39:59.813442 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.813411    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:39:59.835522 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.835486    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/distinct-w0-0a2e13-kserve-55c6d9b449-6t7kb"]
Sep 18 17:39:59.858934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.858895    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:39:59.870929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.870901    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sp7q5\" (UniqueName: \"kubernetes.io/projected/df525e37-9334-445d-aa4b-b9ab59bfa3af-kube-api-access-sp7q5\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.870929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.870925    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.870929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.870936    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df525e37-9334-445d-aa4b-b9ab59bfa3af-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:39:59.874661 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:39:59.874628    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-0a2e13/embedding-w0-0a2e13-kserve-588b8cf69d-wgjcf"]
Sep 18 17:40:00.090082 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:00.090037    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:40:00.093738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:00.093707    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0a2e13-84b76c6b66-jz9zh"]
Sep 18 17:40:00.557921 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:00.557892    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" path="/var/lib/kubelet/pods/34ce9ea9-abc1-45ca-8b0e-bd745a699c6e/volumes"
Sep 18 17:40:00.558391 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:00.558375    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" path="/var/lib/kubelet/pods/d67df7b8-6b70-4d5f-9172-bcb0147262f6/volumes"
Sep 18 17:40:00.558738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:00.558724    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df525e37-9334-445d-aa4b-b9ab59bfa3af" path="/var/lib/kubelet/pods/df525e37-9334-445d-aa4b-b9ab59bfa3af/volumes"
Sep 18 17:40:03.903520 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:03.903478    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:40:03.903967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:03.903758    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" podUID="0c5e7400-4da2-4562-ada2-142d6bc90c48" containerName="payload-processing" containerID="cri-o://d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8" gracePeriod=30
Sep 18 17:40:03.911841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:03.911567    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:40:03.911930 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:03.911803    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" podUID="56ec2d77-aab8-42a5-9073-5137f78da20e" containerName="payload-pre-processing" containerID="cri-o://595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087" gracePeriod=30
Sep 18 17:40:04.208659 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.208627    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:40:04.211423 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.211402    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:40:04.314286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.314245    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume\") pod \"0c5e7400-4da2-4562-ada2-142d6bc90c48\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") "
Sep 18 17:40:04.314504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.314305    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjkjv\" (UniqueName: \"kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv\") pod \"0c5e7400-4da2-4562-ada2-142d6bc90c48\" (UID: \"0c5e7400-4da2-4562-ada2-142d6bc90c48\") "
Sep 18 17:40:04.314504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.314335    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume\") pod \"56ec2d77-aab8-42a5-9073-5137f78da20e\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") "
Sep 18 17:40:04.314504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.314400    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8wd\" (UniqueName: \"kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd\") pod \"56ec2d77-aab8-42a5-9073-5137f78da20e\" (UID: \"56ec2d77-aab8-42a5-9073-5137f78da20e\") "
Sep 18 17:40:04.314973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.314763    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "56ec2d77-aab8-42a5-9073-5137f78da20e" (UID: "56ec2d77-aab8-42a5-9073-5137f78da20e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:40:04.315223 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.315196    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0c5e7400-4da2-4562-ada2-142d6bc90c48" (UID: "0c5e7400-4da2-4562-ada2-142d6bc90c48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:40:04.317366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.317341    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv" (OuterVolumeSpecName: "kube-api-access-fjkjv") pod "0c5e7400-4da2-4562-ada2-142d6bc90c48" (UID: "0c5e7400-4da2-4562-ada2-142d6bc90c48"). InnerVolumeSpecName "kube-api-access-fjkjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:40:04.317449 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.317414    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd" (OuterVolumeSpecName: "kube-api-access-cb8wd") pod "56ec2d77-aab8-42a5-9073-5137f78da20e" (UID: "56ec2d77-aab8-42a5-9073-5137f78da20e"). InnerVolumeSpecName "kube-api-access-cb8wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:40:04.416185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.416146    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c5e7400-4da2-4562-ada2-142d6bc90c48-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:04.416185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.416178    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjkjv\" (UniqueName: \"kubernetes.io/projected/0c5e7400-4da2-4562-ada2-142d6bc90c48-kube-api-access-fjkjv\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:04.416185 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.416191    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56ec2d77-aab8-42a5-9073-5137f78da20e-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:04.416430 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.416205    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8wd\" (UniqueName: \"kubernetes.io/projected/56ec2d77-aab8-42a5-9073-5137f78da20e-kube-api-access-cb8wd\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:04.802514 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.802471    2584 generic.go:356] "Generic (PLEG): container finished" podID="0c5e7400-4da2-4562-ada2-142d6bc90c48" containerID="d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8" exitCode=0
Sep 18 17:40:04.802720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.802522    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"
Sep 18 17:40:04.802720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.802556    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" event={"ID":"0c5e7400-4da2-4562-ada2-142d6bc90c48","Type":"ContainerDied","Data":"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"}
Sep 18 17:40:04.802720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.802613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg" event={"ID":"0c5e7400-4da2-4562-ada2-142d6bc90c48","Type":"ContainerDied","Data":"f1736d9cfb1b7044f0f0e60777fcb87c5d1d5f48c53cde738403797c2d286a04"}
Sep 18 17:40:04.802720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.802637    2584 scope.go:117] "RemoveContainer" containerID="d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"
Sep 18 17:40:04.804079 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.804054    2584 generic.go:356] "Generic (PLEG): container finished" podID="56ec2d77-aab8-42a5-9073-5137f78da20e" containerID="595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087" exitCode=0
Sep 18 17:40:04.804244 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.804099    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" event={"ID":"56ec2d77-aab8-42a5-9073-5137f78da20e","Type":"ContainerDied","Data":"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"}
Sep 18 17:40:04.804244 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.804140    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"
Sep 18 17:40:04.804244 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.804163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx" event={"ID":"56ec2d77-aab8-42a5-9073-5137f78da20e","Type":"ContainerDied","Data":"3c9d4d8b5bad650a68e847c3899f13f9719241bb5d29f8b1e63c579aa1ec7152"}
Sep 18 17:40:04.812950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.812931    2584 scope.go:117] "RemoveContainer" containerID="d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"
Sep 18 17:40:04.813315 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:40:04.813293    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8\": container with ID starting with d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8 not found: ID does not exist" containerID="d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"
Sep 18 17:40:04.813423 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.813324    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8"} err="failed to get container status \"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8\": rpc error: code = NotFound desc = could not find container \"d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8\": container with ID starting with d5eb0db647808483be36c352d5c88c0fa30d62b78f608c77d7159887404fa2b8 not found: ID does not exist"
Sep 18 17:40:04.813423 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.813341    2584 scope.go:117] "RemoveContainer" containerID="595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"
Sep 18 17:40:04.823504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.823479    2584 scope.go:117] "RemoveContainer" containerID="595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"
Sep 18 17:40:04.823806 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:40:04.823786    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087\": container with ID starting with 595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087 not found: ID does not exist" containerID="595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"
Sep 18 17:40:04.823887 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.823818    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087"} err="failed to get container status \"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087\": rpc error: code = NotFound desc = could not find container \"595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087\": container with ID starting with 595401fb9e100787211d59078b72093df216bdb2293869894d466e08cd22c087 not found: ID does not exist"
Sep 18 17:40:04.824296 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.824276    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:40:04.830926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.830897    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-9c0254-596988fdd9-59gvg"]
Sep 18 17:40:04.844585 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.844548    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:40:04.858728 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:04.858694    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-9c0254-6548fb6c8-8l8qx"]
Sep 18 17:40:06.557490 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:06.557464    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c5e7400-4da2-4562-ada2-142d6bc90c48" path="/var/lib/kubelet/pods/0c5e7400-4da2-4562-ada2-142d6bc90c48/volumes"
Sep 18 17:40:06.557846 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:06.557833    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56ec2d77-aab8-42a5-9073-5137f78da20e" path="/var/lib/kubelet/pods/56ec2d77-aab8-42a5-9073-5137f78da20e/volumes"
Sep 18 17:40:08.029936 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:08.029904    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:40:08.030511 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:08.030184    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" containerID="cri-o://a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6" gracePeriod=30
Sep 18 17:40:13.016824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.016784    2584 patch_prober.go:28] interesting pod/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 17:40:13.017300 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.016857    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 17:40:13.274937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.274869    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:40:13.408339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408308    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408373    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408399    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408430    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408461    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408492 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408481    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408515    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408537    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45dpq\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408571    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token\") pod \"bd992764-748f-4ee6-b8e6-0b673256f93c\" (UID: \"bd992764-748f-4ee6-b8e6-0b673256f93c\") "
Sep 18 17:40:13.408763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408664    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:40:13.408943 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408774    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:40:13.408943 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408790    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:40:13.409060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408952    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.409060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408971    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-workload-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.409060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408965    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:40:13.409060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.408986    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-credential-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.409461 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.409136    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:40:13.410900 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.410870    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 17:40:13.411047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.410932    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:40:13.411047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.410988    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:40:13.411216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.411052    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq" (OuterVolumeSpecName: "kube-api-access-45dpq") pod "bd992764-748f-4ee6-b8e6-0b673256f93c" (UID: "bd992764-748f-4ee6-b8e6-0b673256f93c"). InnerVolumeSpecName "kube-api-access-45dpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:40:13.510418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510384    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-podinfo\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.510418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510411    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd992764-748f-4ee6-b8e6-0b673256f93c-istiod-ca-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.510418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510422    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-data\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.510679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510430    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45dpq\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-kube-api-access-45dpq\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.510679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510438    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-token\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.510679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.510446    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd992764-748f-4ee6-b8e6-0b673256f93c-istio-envoy\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:40:13.863342 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.863309    2584 generic.go:356] "Generic (PLEG): container finished" podID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerID="a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6" exitCode=0
Sep 18 17:40:13.863504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.863367    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"
Sep 18 17:40:13.863504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.863399    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerDied","Data":"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"}
Sep 18 17:40:13.863504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.863454    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh" event={"ID":"bd992764-748f-4ee6-b8e6-0b673256f93c","Type":"ContainerDied","Data":"c58b31bed342bbe9ed843cdfcc37a04212c4802f2cafa04fd74377b23ca5659b"}
Sep 18 17:40:13.863504 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.863477    2584 scope.go:117] "RemoveContainer" containerID="a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"
Sep 18 17:40:13.873879 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.873855    2584 scope.go:117] "RemoveContainer" containerID="485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"
Sep 18 17:40:13.883883 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.883859    2584 scope.go:117] "RemoveContainer" containerID="a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"
Sep 18 17:40:13.884289 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:40:13.884264    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6\": container with ID starting with a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6 not found: ID does not exist" containerID="a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"
Sep 18 17:40:13.884392 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.884295    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6"} err="failed to get container status \"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6\": rpc error: code = NotFound desc = could not find container \"a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6\": container with ID starting with a701986666963b2cd9b3890c551a8a43a5f82de9fedfda8f5446c78cf3a760f6 not found: ID does not exist"
Sep 18 17:40:13.884392 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.884313    2584 scope.go:117] "RemoveContainer" containerID="485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"
Sep 18 17:40:13.884594 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:40:13.884572    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488\": container with ID starting with 485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488 not found: ID does not exist" containerID="485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"
Sep 18 17:40:13.884656 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.884605    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488"} err="failed to get container status \"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488\": rpc error: code = NotFound desc = could not find container \"485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488\": container with ID starting with 485e210ccd5308dddcdb6db61c197e9f1e533a4db2ef88313e2de45ad4a8b488 not found: ID does not exist"
Sep 18 17:40:13.886181 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.886160    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:40:13.892163 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:13.892114    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-0a2e13-openshift-default-5d6785f4bd-q4ksh"]
Sep 18 17:40:14.557982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:40:14.557942    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" path="/var/lib/kubelet/pods/bd992764-748f-4ee6-b8e6-0b673256f93c/volumes"
Sep 18 17:41:03.746989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:03.746957    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:41:03.747620 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:03.747195    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" podUID="8d51620a-decd-42ff-bb36-ce6e210d05ae" containerName="maas-api" containerID="cri-o://83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c" gracePeriod=30
Sep 18 17:41:04.004731 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.004660    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:41:04.100937 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.100895    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs\") pod \"8d51620a-decd-42ff-bb36-ce6e210d05ae\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") "
Sep 18 17:41:04.101166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.100989    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca\") pod \"8d51620a-decd-42ff-bb36-ce6e210d05ae\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") "
Sep 18 17:41:04.101166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.101043    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") pod \"8d51620a-decd-42ff-bb36-ce6e210d05ae\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") "
Sep 18 17:41:04.101300 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.101160    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk74m\" (UniqueName: \"kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m\") pod \"8d51620a-decd-42ff-bb36-ce6e210d05ae\" (UID: \"8d51620a-decd-42ff-bb36-ce6e210d05ae\") "
Sep 18 17:41:04.101472 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.101440    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8d51620a-decd-42ff-bb36-ce6e210d05ae" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:41:04.101607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.101566    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d51620a-decd-42ff-bb36-ce6e210d05ae-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:04.103626 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.103597    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m" (OuterVolumeSpecName: "kube-api-access-wk74m") pod "8d51620a-decd-42ff-bb36-ce6e210d05ae" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae"). InnerVolumeSpecName "kube-api-access-wk74m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:41:04.103743 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.103713    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8d51620a-decd-42ff-bb36-ce6e210d05ae" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:41:04.103743 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.103730    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8d51620a-decd-42ff-bb36-ce6e210d05ae" (UID: "8d51620a-decd-42ff-bb36-ce6e210d05ae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:41:04.159462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.159380    2584 generic.go:356] "Generic (PLEG): container finished" podID="8d51620a-decd-42ff-bb36-ce6e210d05ae" containerID="83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c" exitCode=0
Sep 18 17:41:04.159462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.159455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" event={"ID":"8d51620a-decd-42ff-bb36-ce6e210d05ae","Type":"ContainerDied","Data":"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"}
Sep 18 17:41:04.159721 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.159442    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"
Sep 18 17:41:04.159721 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.159508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t" event={"ID":"8d51620a-decd-42ff-bb36-ce6e210d05ae","Type":"ContainerDied","Data":"c2af2b7329e6c42768b8a5c48ab09204b8b9630d3314017c7fa4d0a116865713"}
Sep 18 17:41:04.159721 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.159530    2584 scope.go:117] "RemoveContainer" containerID="83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"
Sep 18 17:41:04.170356 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.170332    2584 scope.go:117] "RemoveContainer" containerID="83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"
Sep 18 17:41:04.170693 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:41:04.170672    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c\": container with ID starting with 83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c not found: ID does not exist" containerID="83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"
Sep 18 17:41:04.170755 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.170703    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c"} err="failed to get container status \"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c\": rpc error: code = NotFound desc = could not find container \"83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c\": container with ID starting with 83dda4a81cec27852f0b8738f8b456c8b68ba3ece62ccf2a0b83dba3dac60c0c not found: ID does not exist"
Sep 18 17:41:04.184717 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.184652    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:41:04.190211 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.190179    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-66efa6-754d8cb5f8-6gl2t"]
Sep 18 17:41:04.202214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.202189    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:04.202214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.202211    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8d51620a-decd-42ff-bb36-ce6e210d05ae-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:04.202214 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.202220    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk74m\" (UniqueName: \"kubernetes.io/projected/8d51620a-decd-42ff-bb36-ce6e210d05ae-kube-api-access-wk74m\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:04.556573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:04.556538    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d51620a-decd-42ff-bb36-ce6e210d05ae" path="/var/lib/kubelet/pods/8d51620a-decd-42ff-bb36-ce6e210d05ae/volumes"
Sep 18 17:41:29.954088 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:29.954051    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:41:40.858066 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.858035    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:41:40.859034 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.858279    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" podUID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" containerName="maas-api" containerID="cri-o://509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad" gracePeriod=30
Sep 18 17:41:40.910747 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.910700    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:41:40.910996 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.910962    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" podUID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" containerName="payload-processing" containerID="cri-o://e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed" gracePeriod=30
Sep 18 17:41:40.919967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.919938    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:41:40.920259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:40.920218    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" podUID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" containerName="payload-pre-processing" containerID="cri-o://7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c" gracePeriod=30
Sep 18 17:41:41.225335 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.225308    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:41:41.228269 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.228249    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:41:41.243420 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.243394    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:41:41.332413 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332382    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume\") pod \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") "
Sep 18 17:41:41.332413 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332417    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume\") pod \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332447    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcxj2\" (UniqueName: \"kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2\") pod \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\" (UID: \"6b7eb932-873f-4911-be34-b1bc3a3d7b71\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmsln\" (UniqueName: \"kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln\") pod \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332505    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs\") pod \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332520    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls\") pod \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332571    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca\") pod \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\" (UID: \"62ac85ee-bcbe-4f0f-af87-06cc9aac069c\") "
Sep 18 17:41:41.332639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332610    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w668m\" (UniqueName: \"kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m\") pod \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\" (UID: \"3d95f0bf-3eb2-44e5-92d5-473140bb99d0\") "
Sep 18 17:41:41.332982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332935    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3d95f0bf-3eb2-44e5-92d5-473140bb99d0" (UID: "3d95f0bf-3eb2-44e5-92d5-473140bb99d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:41:41.332982 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.332959    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "62ac85ee-bcbe-4f0f-af87-06cc9aac069c" (UID: "62ac85ee-bcbe-4f0f-af87-06cc9aac069c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:41:41.333475 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.333439    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b7eb932-873f-4911-be34-b1bc3a3d7b71" (UID: "6b7eb932-873f-4911-be34-b1bc3a3d7b71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:41:41.334967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.334941    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "62ac85ee-bcbe-4f0f-af87-06cc9aac069c" (UID: "62ac85ee-bcbe-4f0f-af87-06cc9aac069c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:41:41.335077 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.334984    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln" (OuterVolumeSpecName: "kube-api-access-gmsln") pod "62ac85ee-bcbe-4f0f-af87-06cc9aac069c" (UID: "62ac85ee-bcbe-4f0f-af87-06cc9aac069c"). InnerVolumeSpecName "kube-api-access-gmsln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:41:41.335077 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.335006    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2" (OuterVolumeSpecName: "kube-api-access-qcxj2") pod "6b7eb932-873f-4911-be34-b1bc3a3d7b71" (UID: "6b7eb932-873f-4911-be34-b1bc3a3d7b71"). InnerVolumeSpecName "kube-api-access-qcxj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:41:41.335438 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.335419    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "62ac85ee-bcbe-4f0f-af87-06cc9aac069c" (UID: "62ac85ee-bcbe-4f0f-af87-06cc9aac069c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:41:41.335438 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.335428    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m" (OuterVolumeSpecName: "kube-api-access-w668m") pod "3d95f0bf-3eb2-44e5-92d5-473140bb99d0" (UID: "3d95f0bf-3eb2-44e5-92d5-473140bb99d0"). InnerVolumeSpecName "kube-api-access-w668m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:41:41.366376 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.366341    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" containerID="7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c" exitCode=0
Sep 18 17:41:41.366601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.366384    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"
Sep 18 17:41:41.366601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.366422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" event={"ID":"6b7eb932-873f-4911-be34-b1bc3a3d7b71","Type":"ContainerDied","Data":"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"}
Sep 18 17:41:41.366601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.366477    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp" event={"ID":"6b7eb932-873f-4911-be34-b1bc3a3d7b71","Type":"ContainerDied","Data":"4039f68e811085f7c4e2b650c9435d107077fab92b1905227794588654936517"}
Sep 18 17:41:41.366601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.366509    2584 scope.go:117] "RemoveContainer" containerID="7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"
Sep 18 17:41:41.368036 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.368014    2584 generic.go:356] "Generic (PLEG): container finished" podID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" containerID="509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad" exitCode=0
Sep 18 17:41:41.368136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.368055    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"
Sep 18 17:41:41.368136 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.368066    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" event={"ID":"62ac85ee-bcbe-4f0f-af87-06cc9aac069c","Type":"ContainerDied","Data":"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"}
Sep 18 17:41:41.368262 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.368146    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t" event={"ID":"62ac85ee-bcbe-4f0f-af87-06cc9aac069c","Type":"ContainerDied","Data":"8215be2e94e3b70e0c1b00bd7f0d28d0efbf60776584a569c0e2767a09573593"}
Sep 18 17:41:41.369799 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.369775    2584 generic.go:356] "Generic (PLEG): container finished" podID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" containerID="e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed" exitCode=0
Sep 18 17:41:41.369918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.369823    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"
Sep 18 17:41:41.369918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.369838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" event={"ID":"3d95f0bf-3eb2-44e5-92d5-473140bb99d0","Type":"ContainerDied","Data":"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"}
Sep 18 17:41:41.369918 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.369874    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf" event={"ID":"3d95f0bf-3eb2-44e5-92d5-473140bb99d0","Type":"ContainerDied","Data":"cd38500e7cfd92092114b90571919f603ec1003d8bf99fca5edd1b0e8243332b"}
Sep 18 17:41:41.377772 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.377736    2584 scope.go:117] "RemoveContainer" containerID="7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"
Sep 18 17:41:41.378301 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:41:41.378132    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c\": container with ID starting with 7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c not found: ID does not exist" containerID="7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"
Sep 18 17:41:41.378301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.378174    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c"} err="failed to get container status \"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c\": rpc error: code = NotFound desc = could not find container \"7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c\": container with ID starting with 7f5a288a9cf7c65d69c2aa316c2b71548b5ec4f95f5669046ef723c5947deb0c not found: ID does not exist"
Sep 18 17:41:41.378301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.378207    2584 scope.go:117] "RemoveContainer" containerID="509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"
Sep 18 17:41:41.390864 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.390838    2584 scope.go:117] "RemoveContainer" containerID="509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"
Sep 18 17:41:41.391336 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:41:41.391308    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad\": container with ID starting with 509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad not found: ID does not exist" containerID="509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"
Sep 18 17:41:41.391456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.391349    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad"} err="failed to get container status \"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad\": rpc error: code = NotFound desc = could not find container \"509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad\": container with ID starting with 509ee82fe615101617737521ace749fcb6699796ef72bf0a9a371baa1b5ed9ad not found: ID does not exist"
Sep 18 17:41:41.391456 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.391375    2584 scope.go:117] "RemoveContainer" containerID="e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"
Sep 18 17:41:41.401328 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.401307    2584 scope.go:117] "RemoveContainer" containerID="e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"
Sep 18 17:41:41.401668 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:41:41.401649    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed\": container with ID starting with e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed not found: ID does not exist" containerID="e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"
Sep 18 17:41:41.401737 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.401677    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed"} err="failed to get container status \"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed\": rpc error: code = NotFound desc = could not find container \"e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed\": container with ID starting with e7a794a6f9f7acd753c9ab484f29486516177860e19471b4d6e50577a34c76ed not found: ID does not exist"
Sep 18 17:41:41.403934 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.403913    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:41:41.411979 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.411945    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5b6d69-594f5c8fcd-vz6pp"]
Sep 18 17:41:41.424809 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.424766    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:41:41.431021 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.430991    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-5b6d69-687cd645f-qt2qf"]
Sep 18 17:41:41.433644 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433620    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433644    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w668m\" (UniqueName: \"kubernetes.io/projected/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-kube-api-access-w668m\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433659    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3d95f0bf-3eb2-44e5-92d5-473140bb99d0-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433672    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b7eb932-873f-4911-be34-b1bc3a3d7b71-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433683    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcxj2\" (UniqueName: \"kubernetes.io/projected/6b7eb932-873f-4911-be34-b1bc3a3d7b71-kube-api-access-qcxj2\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433695    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmsln\" (UniqueName: \"kubernetes.io/projected/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-kube-api-access-gmsln\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433706    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.433777 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.433717    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/62ac85ee-bcbe-4f0f-af87-06cc9aac069c-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:41.453442 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.453413    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:41:41.460980 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:41.460949    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5b6d69-7db5c4b9d8-df97t"]
Sep 18 17:41:42.557985 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:42.557947    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" path="/var/lib/kubelet/pods/3d95f0bf-3eb2-44e5-92d5-473140bb99d0/volumes"
Sep 18 17:41:42.558520 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:42.558349    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" path="/var/lib/kubelet/pods/62ac85ee-bcbe-4f0f-af87-06cc9aac069c/volumes"
Sep 18 17:41:42.558679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:42.558664    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" path="/var/lib/kubelet/pods/6b7eb932-873f-4911-be34-b1bc3a3d7b71/volumes"
Sep 18 17:41:44.974235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:44.974196    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" podUID="14446f7d-9fa9-4fe4-a963-eeef661ba891" containerName="main" containerID="cri-o://0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0" gracePeriod=45
Sep 18 17:41:45.223072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.223043    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:41:45.268235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268140    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268235 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268195    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clpmt\" (UniqueName: \"kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268240    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268269    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268303    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268487 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268403    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home\") pod \"14446f7d-9fa9-4fe4-a963-eeef661ba891\" (UID: \"14446f7d-9fa9-4fe4-a963-eeef661ba891\") "
Sep 18 17:41:45.268875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268830    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:41:45.268875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268858    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache" (OuterVolumeSpecName: "model-cache") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:41:45.268875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.268870    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home" (OuterVolumeSpecName: "home") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:41:45.270668 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.270642    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:41:45.271187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.271158    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt" (OuterVolumeSpecName: "kube-api-access-clpmt") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "kube-api-access-clpmt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:41:45.271280 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.271224    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm" (OuterVolumeSpecName: "dshm") pod "14446f7d-9fa9-4fe4-a963-eeef661ba891" (UID: "14446f7d-9fa9-4fe4-a963-eeef661ba891"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:41:45.370008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.369969    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-dshm\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.370008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.370002    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14446f7d-9fa9-4fe4-a963-eeef661ba891-tls-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.370008 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.370016    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-tmp-dir\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.370275 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.370026    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-home\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.370275 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.370037    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14446f7d-9fa9-4fe4-a963-eeef661ba891-model-cache\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.370275 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.370049    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clpmt\" (UniqueName: \"kubernetes.io/projected/14446f7d-9fa9-4fe4-a963-eeef661ba891-kube-api-access-clpmt\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:41:45.396387 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.396350    2584 generic.go:356] "Generic (PLEG): container finished" podID="14446f7d-9fa9-4fe4-a963-eeef661ba891" containerID="0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0" exitCode=0
Sep 18 17:41:45.396387 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.396391    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"
Sep 18 17:41:45.396566 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.396424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" event={"ID":"14446f7d-9fa9-4fe4-a963-eeef661ba891","Type":"ContainerDied","Data":"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"}
Sep 18 17:41:45.396566 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.396465    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p" event={"ID":"14446f7d-9fa9-4fe4-a963-eeef661ba891","Type":"ContainerDied","Data":"710556d4984f527c6b276d47a1ad2ff877cdb8ffaa2c6fc391c592a32cff8892"}
Sep 18 17:41:45.396566 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.396497    2584 scope.go:117] "RemoveContainer" containerID="0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"
Sep 18 17:41:45.406684 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.406667    2584 scope.go:117] "RemoveContainer" containerID="0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"
Sep 18 17:41:45.406969 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:41:45.406952    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0\": container with ID starting with 0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0 not found: ID does not exist" containerID="0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"
Sep 18 17:41:45.407017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.406979    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0"} err="failed to get container status \"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0\": rpc error: code = NotFound desc = could not find container \"0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0\": container with ID starting with 0edf4c71404d2b4f528a9fee82a4c485e823cce93ea21f9b228a8f70cd68c3f0 not found: ID does not exist"
Sep 18 17:41:45.419346 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.419314    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:41:45.423707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:45.423682    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5b6d69/distinct-w4-5b6d69-kserve-58fd7548c5-nzr4p"]
Sep 18 17:41:46.557164 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:41:46.557133    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14446f7d-9fa9-4fe4-a963-eeef661ba891" path="/var/lib/kubelet/pods/14446f7d-9fa9-4fe4-a963-eeef661ba891/volumes"
Sep 18 17:44:28.683888 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:28.683862    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:44:28.689240 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:28.689219    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:44:53.143316 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143281    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:44:53.143831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143809    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14446f7d-9fa9-4fe4-a963-eeef661ba891" containerName="main"
Sep 18 17:44:53.143889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143836    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="14446f7d-9fa9-4fe4-a963-eeef661ba891" containerName="main"
Sep 18 17:44:53.143889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143852    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:53.143889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143861    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:53.143889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143876    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df525e37-9334-445d-aa4b-b9ab59bfa3af" containerName="maas-api"
Sep 18 17:44:53.143889 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143886    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="df525e37-9334-445d-aa4b-b9ab59bfa3af" containerName="maas-api"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143902    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" containerName="main"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143910    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" containerName="main"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143923    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56ec2d77-aab8-42a5-9073-5137f78da20e" containerName="payload-pre-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143931    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="56ec2d77-aab8-42a5-9073-5137f78da20e" containerName="payload-pre-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143944    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" containerName="payload-pre-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143953    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" containerName="payload-pre-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143970    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" containerName="main"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143977    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" containerName="main"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143986    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" containerName="payload-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.143994    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" containerName="payload-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144005    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d51620a-decd-42ff-bb36-ce6e210d05ae" containerName="maas-api"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144014    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d51620a-decd-42ff-bb36-ce6e210d05ae" containerName="maas-api"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144028    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" containerName="maas-api"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144036    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" containerName="maas-api"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144048    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c5e7400-4da2-4562-ada2-142d6bc90c48" containerName="payload-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144056    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c5e7400-4da2-4562-ada2-142d6bc90c48" containerName="payload-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144163    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b7eb932-873f-4911-be34-b1bc3a3d7b71" containerName="payload-pre-processing"
Sep 18 17:44:53.144171 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144179    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="62ac85ee-bcbe-4f0f-af87-06cc9aac069c" containerName="maas-api"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144198    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="14446f7d-9fa9-4fe4-a963-eeef661ba891" containerName="main"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144207    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c5e7400-4da2-4562-ada2-142d6bc90c48" containerName="payload-processing"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144216    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144224    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d51620a-decd-42ff-bb36-ce6e210d05ae" containerName="maas-api"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144233    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d95f0bf-3eb2-44e5-92d5-473140bb99d0" containerName="payload-processing"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144241    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d67df7b8-6b70-4d5f-9172-bcb0147262f6" containerName="main"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144249    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ce9ea9-abc1-45ca-8b0e-bd745a699c6e" containerName="main"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144258    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="df525e37-9334-445d-aa4b-b9ab59bfa3af" containerName="maas-api"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144265    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="56ec2d77-aab8-42a5-9073-5137f78da20e" containerName="payload-pre-processing"
Sep 18 17:44:53.144928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.144274    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:53.147745 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.147717    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.150866 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.150844    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-828a86-openshift-default-dockercfg-9cz8l\""
Sep 18 17:44:53.166408 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.166385    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:44:53.281776 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281735    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.281984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.281984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281826    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.281984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281853    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdnh\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.281984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.281984 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.281952    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.282255 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.282002    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.282255 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.282040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.282255 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.282083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.382875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.382875 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.382994    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdnh\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383133 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383073    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383531 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383531 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383531 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383471    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.383692 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.383667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.384304 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.384277    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.385547 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.385520    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.385665 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.385648    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.391601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.391579    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.391809 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.391789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdnh\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh\") pod \"e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") " pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.461097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.461021    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:53.741140 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.741098    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:44:53.742679 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:44:53.742648    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3c945a_7a65_44a1_9540_d22157960894.slice/crio-976081cac0a5c55fb17eb720ca111f04c4325d4d7c026ea3db84132fe92d1ebc WatchSource:0}: Error finding container 976081cac0a5c55fb17eb720ca111f04c4325d4d7c026ea3db84132fe92d1ebc: Status 404 returned error can't find the container with id 976081cac0a5c55fb17eb720ca111f04c4325d4d7c026ea3db84132fe92d1ebc
Sep 18 17:44:53.744814 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.744783    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:44:53.744880 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.744844    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:44:53.744880 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:53.744871    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:44:54.391672 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:54.391640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerStarted","Data":"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"}
Sep 18 17:44:54.392060 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:54.391692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerStarted","Data":"976081cac0a5c55fb17eb720ca111f04c4325d4d7c026ea3db84132fe92d1ebc"}
Sep 18 17:44:54.422552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:54.422494    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podStartSLOduration=1.422478937 podStartE2EDuration="1.422478937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:44:54.421190834 +0000 UTC m=+1826.363448444" watchObservedRunningTime="2026-09-18 17:44:54.422478937 +0000 UTC m=+1826.364736613"
Sep 18 17:44:54.462052 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:54.462025    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:54.467770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:54.467751    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:55.396882 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:55.396848    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:55.397706 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:55.397686    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:44:59.088987 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.088957    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:44:59.089594 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.089572    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:59.089639 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.089600    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd992764-748f-4ee6-b8e6-0b673256f93c" containerName="istio-proxy"
Sep 18 17:44:59.093017 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.092992    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.099033 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.099012    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-828a86\""
Sep 18 17:44:59.099198 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.099053    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-828a86-dockercfg-f2fxc\""
Sep 18 17:44:59.106273 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.106250    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:44:59.235344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.235309    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.235508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.235360    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvxh5\" (UniqueName: \"kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.336600 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.336556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.336756 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.336620    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvxh5\" (UniqueName: \"kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.337261 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.337243    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.346976 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.346919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvxh5\" (UniqueName: \"kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5\") pod \"payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.404823 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.404799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:44:59.685299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:44:59.685268    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:44:59.686542 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:44:59.686502    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a2075b_adbe_41f8_b6b0_6e4028cddbb4.slice/crio-d19ef67d68d735101cbc640c6844114f8d309b0e4a276606f7958841eb7b87cc WatchSource:0}: Error finding container d19ef67d68d735101cbc640c6844114f8d309b0e4a276606f7958841eb7b87cc: Status 404 returned error can't find the container with id d19ef67d68d735101cbc640c6844114f8d309b0e4a276606f7958841eb7b87cc
Sep 18 17:45:00.146006 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.145971    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"]
Sep 18 17:45:00.149508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.149485    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"
Sep 18 17:45:00.157649 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.157625    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qt978\""
Sep 18 17:45:00.164932 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.164462    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"]
Sep 18 17:45:00.169047 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.169028    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"
Sep 18 17:45:00.426764 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.426683    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" event={"ID":"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4","Type":"ContainerStarted","Data":"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"}
Sep 18 17:45:00.426764 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.426733    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" event={"ID":"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4","Type":"ContainerStarted","Data":"d19ef67d68d735101cbc640c6844114f8d309b0e4a276606f7958841eb7b87cc"}
Sep 18 17:45:00.426976 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.426809    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:45:00.451641 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.451617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"]
Sep 18 17:45:00.453834 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:45:00.453808    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cd640a_9587_4f51_a77e_5be1eea8c1ab.slice/crio-4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126 WatchSource:0}: Error finding container 4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126: Status 404 returned error can't find the container with id 4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126
Sep 18 17:45:00.454016 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.453969    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" podStartSLOduration=1.4539529629999999 podStartE2EDuration="1.453952963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:45:00.448506804 +0000 UTC m=+1832.390764413" watchObservedRunningTime="2026-09-18 17:45:00.453952963 +0000 UTC m=+1832.396210573"
Sep 18 17:45:00.455916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:00.455898    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:45:01.433335 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:01.433298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx" event={"ID":"43cd640a-9587-4f51-a77e-5be1eea8c1ab","Type":"ContainerStarted","Data":"4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126"}
Sep 18 17:45:03.446763 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:03.446731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx" event={"ID":"43cd640a-9587-4f51-a77e-5be1eea8c1ab","Type":"ContainerStarted","Data":"3bf8c83f32977ea7d58603ad77004caace7c60c74c1f035860a2e618fb2af291"}
Sep 18 17:45:03.462679 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:03.462636    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx" podStartSLOduration=1.114488199 podStartE2EDuration="3.46262074s" totalImagesPullingTime="2.348132541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:45:03.462011082 +0000 UTC m=+1835.404268692" watchObservedRunningTime="2026-09-18 17:45:03.46262074 +0000 UTC m=+1835.404878349"
Sep 18 17:45:04.457394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:04.456937    2584 generic.go:356] "Generic (PLEG): container finished" podID="43cd640a-9587-4f51-a77e-5be1eea8c1ab" containerID="3bf8c83f32977ea7d58603ad77004caace7c60c74c1f035860a2e618fb2af291" exitCode=0
Sep 18 17:45:04.457394 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:04.457037    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx" event={"ID":"43cd640a-9587-4f51-a77e-5be1eea8c1ab","Type":"ContainerDied","Data":"3bf8c83f32977ea7d58603ad77004caace7c60c74c1f035860a2e618fb2af291"}
Sep 18 17:45:05.614466 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:05.614444    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"
Sep 18 17:45:06.477158 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:06.477129    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"
Sep 18 17:45:06.477353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:06.477159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx" event={"ID":"43cd640a-9587-4f51-a77e-5be1eea8c1ab","Type":"ContainerDied","Data":"4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126"}
Sep 18 17:45:06.477353 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:06.477230    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bd63919d195687f131201ddfaf0cfd528da33c20a02426daa836678296bf126"
Sep 18 17:45:11.436146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:11.436089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:45:11.438286 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:11.438258    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 17:45:11.438341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:11.438322    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 17:45:13.518266 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.518226    2584 generic.go:356] "Generic (PLEG): container finished" podID="0a3c945a-7a65-44a1-9540-d22157960894" containerID="1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d" exitCode=0
Sep 18 17:45:13.518812 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.518284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerDied","Data":"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"}
Sep 18 17:45:13.518812 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.518791    2584 scope.go:117] "RemoveContainer" containerID="1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"
Sep 18 17:45:13.519962 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.519930    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:45:13.520036 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.520004    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:45:13.520076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:13.520037    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 18 17:45:14.525430 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:14.525394    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerStarted","Data":"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"}
Sep 18 17:45:15.461893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:15.461859    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:45:15.462097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:15.462075    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 18 17:45:15.462172 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:15.462145    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 18 17:45:16.461949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:16.461913    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 18 17:45:16.462367 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:16.461966    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 18 17:45:17.462317 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:17.462280    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 18 17:45:17.462715 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:17.462354    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 18 17:45:18.461601 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:18.461561    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 18 17:45:18.461796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:18.461639    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 18 17:45:19.461676 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:19.461635    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 18 17:45:19.462053 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:19.461703    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 18 17:45:20.465558 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:20.465529    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:45:20.465954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:20.465784    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:45:20.466506 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:20.466488    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:45:34.874216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.874181    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:45:34.874693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.874561    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43cd640a-9587-4f51-a77e-5be1eea8c1ab" containerName="cleanup"
Sep 18 17:45:34.874693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.874573    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="43cd640a-9587-4f51-a77e-5be1eea8c1ab" containerName="cleanup"
Sep 18 17:45:34.874693 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.874643    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="43cd640a-9587-4f51-a77e-5be1eea8c1ab" containerName="cleanup"
Sep 18 17:45:34.877721 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.877705    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:34.881325 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.881074    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a8bdd6\""
Sep 18 17:45:34.881325 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.881244    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a8bdd6-dockercfg-5wslj\""
Sep 18 17:45:34.893416 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.893393    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:45:34.947072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.947041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:34.947274 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:34.947092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p6rc\" (UniqueName: \"kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.048500 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.048463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.048691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.048533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p6rc\" (UniqueName: \"kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.049257 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.049238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.058140 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.058078    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p6rc\" (UniqueName: \"kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc\") pod \"payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.190936 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.190873    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.466216 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.466190    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:45:35.468022 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:45:35.467994    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6b36d2_a287_4555_8d8e_004b9f694b1f.slice/crio-79ba8b0c8245c42e6d9a614f09c3a07080a77525b9d56846b5692c9c0c9ffdca WatchSource:0}: Error finding container 79ba8b0c8245c42e6d9a614f09c3a07080a77525b9d56846b5692c9c0c9ffdca: Status 404 returned error can't find the container with id 79ba8b0c8245c42e6d9a614f09c3a07080a77525b9d56846b5692c9c0c9ffdca
Sep 18 17:45:35.650072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.650038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" event={"ID":"6e6b36d2-a287-4555-8d8e-004b9f694b1f","Type":"ContainerStarted","Data":"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"}
Sep 18 17:45:35.650236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.650202    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:45:35.650236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.650225    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" event={"ID":"6e6b36d2-a287-4555-8d8e-004b9f694b1f","Type":"ContainerStarted","Data":"79ba8b0c8245c42e6d9a614f09c3a07080a77525b9d56846b5692c9c0c9ffdca"}
Sep 18 17:45:35.671186 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:35.671132    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" podStartSLOduration=1.671094528 podStartE2EDuration="1.671094528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:45:35.668859783 +0000 UTC m=+1867.611117394" watchObservedRunningTime="2026-09-18 17:45:35.671094528 +0000 UTC m=+1867.613352141"
Sep 18 17:45:46.657237 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:45:46.657196    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:46:06.074362 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:06.074263    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"
Sep 18 17:46:06.205881 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:06.205857    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829_6e6b36d2-a287-4555-8d8e-004b9f694b1f/payload-processing/0.log"
Sep 18 17:46:47.636464 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:47.636434    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"
Sep 18 17:46:47.749642 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:47.749615    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829_6e6b36d2-a287-4555-8d8e-004b9f694b1f/payload-processing/0.log"
Sep 18 17:46:47.858771 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:47.858749    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829_6e6b36d2-a287-4555-8d8e-004b9f694b1f/payload-processing/0.log"
Sep 18 17:46:55.240321 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.240261    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:46:55.244519 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.244498    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.247154 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.247127    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-88b9e1-serving-cert\""
Sep 18 17:46:55.247284 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.247268    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sjtq4\""
Sep 18 17:46:55.255485 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.255461    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:46:55.385670 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.385631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.385865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.385684    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.385865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.385767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.385865 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.385837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jr95\" (UniqueName: \"kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.486949 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.486923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.487089 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.486971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.487089 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.487037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.487213 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.487096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jr95\" (UniqueName: \"kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.487259 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:46:55.487214    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-serving-cert: secret "maas-api-e2e-ipp-cleanup-88b9e1-serving-cert" not found
Sep 18 17:46:55.487300 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:46:55.487293    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls podName:13d13392-af25-4d09-bf5b-61ebff79aa9d nodeName:}" failed. No retries permitted until 2026-09-18 17:46:55.987272868 +0000 UTC m=+1947.929530455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" (UID: "13d13392-af25-4d09-bf5b-61ebff79aa9d") : secret "maas-api-e2e-ipp-cleanup-88b9e1-serving-cert" not found
Sep 18 17:46:55.487873 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.487847    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.489606 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.489586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.498513 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.498461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jr95\" (UniqueName: \"kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.991510 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.991473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:55.994211 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:55.994187    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:56.158151 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.158099    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:56.239404 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.239371    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:46:56.244174 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.243984    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.247470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.247261    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-88b9e1-dockercfg-qsv2p\""
Sep 18 17:46:56.247780 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.247750    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-88b9e1\""
Sep 18 17:46:56.255906 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.255884    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:46:56.395620 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.395590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jkbx\" (UniqueName: \"kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.395794 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.395637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.450317 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.450293    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:46:56.451707 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:46:56.451678    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d13392_af25_4d09_bf5b_61ebff79aa9d.slice/crio-e7c29ae3293cbfdcbab23e8493ec9290c5c17dcb1d480f50d11ab53f0304f3df WatchSource:0}: Error finding container e7c29ae3293cbfdcbab23e8493ec9290c5c17dcb1d480f50d11ab53f0304f3df: Status 404 returned error can't find the container with id e7c29ae3293cbfdcbab23e8493ec9290c5c17dcb1d480f50d11ab53f0304f3df
Sep 18 17:46:56.496416 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.496363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jkbx\" (UniqueName: \"kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.496416 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.496404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.497187 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.497165    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.506985 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.506968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jkbx\" (UniqueName: \"kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx\") pod \"payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.557033 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.557011    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:56.835306 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:56.835278    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:46:56.841507 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:46:56.841464    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7274d73d_7890_45bb_981b_f5dfcab8938d.slice/crio-d1429da5005accbbdb50703851cbf88f536261f03b1bc0991184dc20bd25410a WatchSource:0}: Error finding container d1429da5005accbbdb50703851cbf88f536261f03b1bc0991184dc20bd25410a: Status 404 returned error can't find the container with id d1429da5005accbbdb50703851cbf88f536261f03b1bc0991184dc20bd25410a
Sep 18 17:46:57.091607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.091523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" event={"ID":"7274d73d-7890-45bb-981b-f5dfcab8938d","Type":"ContainerStarted","Data":"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"}
Sep 18 17:46:57.091607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.091590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" event={"ID":"7274d73d-7890-45bb-981b-f5dfcab8938d","Type":"ContainerStarted","Data":"d1429da5005accbbdb50703851cbf88f536261f03b1bc0991184dc20bd25410a"}
Sep 18 17:46:57.091831 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.091634    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:46:57.093441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.093411    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" event={"ID":"13d13392-af25-4d09-bf5b-61ebff79aa9d","Type":"ContainerStarted","Data":"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"}
Sep 18 17:46:57.093567 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.093472    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" event={"ID":"13d13392-af25-4d09-bf5b-61ebff79aa9d","Type":"ContainerStarted","Data":"e7c29ae3293cbfdcbab23e8493ec9290c5c17dcb1d480f50d11ab53f0304f3df"}
Sep 18 17:46:57.093567 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.093500    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:46:57.111200 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.111156    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" podStartSLOduration=1.111143535 podStartE2EDuration="1.111143535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:46:57.110050153 +0000 UTC m=+1949.052307763" watchObservedRunningTime="2026-09-18 17:46:57.111143535 +0000 UTC m=+1949.053401143"
Sep 18 17:46:57.128241 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:46:57.128193    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" podStartSLOduration=1.755964478 podStartE2EDuration="2.128180491s" totalImagesPullingTime="372.216013ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:46:57.127164571 +0000 UTC m=+1949.069422181" watchObservedRunningTime="2026-09-18 17:46:57.128180491 +0000 UTC m=+1949.070438099"
Sep 18 17:47:03.104484 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:03.104449    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:47:08.100687 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:08.100652    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:47:33.413581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.413549    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:47:33.414170 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.413763    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" podUID="13d13392-af25-4d09-bf5b-61ebff79aa9d" containerName="maas-api" containerID="cri-o://44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25" gracePeriod=30
Sep 18 17:47:33.507135 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.507065    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:47:33.507340 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.507314    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" podUID="7274d73d-7890-45bb-981b-f5dfcab8938d" containerName="payload-processing" containerID="cri-o://6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d" gracePeriod=30
Sep 18 17:47:33.769470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.769446    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:47:33.772241 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.772221    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:47:33.809780 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.809751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jr95\" (UniqueName: \"kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95\") pod \"13d13392-af25-4d09-bf5b-61ebff79aa9d\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") "
Sep 18 17:47:33.809951 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.809819    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca\") pod \"13d13392-af25-4d09-bf5b-61ebff79aa9d\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") "
Sep 18 17:47:33.809951 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.809867    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs\") pod \"13d13392-af25-4d09-bf5b-61ebff79aa9d\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") "
Sep 18 17:47:33.809951 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.809917    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") pod \"13d13392-af25-4d09-bf5b-61ebff79aa9d\" (UID: \"13d13392-af25-4d09-bf5b-61ebff79aa9d\") "
Sep 18 17:47:33.810349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.810318    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "13d13392-af25-4d09-bf5b-61ebff79aa9d" (UID: "13d13392-af25-4d09-bf5b-61ebff79aa9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:47:33.812723 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.812631    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "13d13392-af25-4d09-bf5b-61ebff79aa9d" (UID: "13d13392-af25-4d09-bf5b-61ebff79aa9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:47:33.812916 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.812895    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "13d13392-af25-4d09-bf5b-61ebff79aa9d" (UID: "13d13392-af25-4d09-bf5b-61ebff79aa9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:47:33.813087 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.813048    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95" (OuterVolumeSpecName: "kube-api-access-4jr95") pod "13d13392-af25-4d09-bf5b-61ebff79aa9d" (UID: "13d13392-af25-4d09-bf5b-61ebff79aa9d"). InnerVolumeSpecName "kube-api-access-4jr95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:47:33.910669 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.910636    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume\") pod \"7274d73d-7890-45bb-981b-f5dfcab8938d\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") "
Sep 18 17:47:33.910830 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.910719    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jkbx\" (UniqueName: \"kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx\") pod \"7274d73d-7890-45bb-981b-f5dfcab8938d\" (UID: \"7274d73d-7890-45bb-981b-f5dfcab8938d\") "
Sep 18 17:47:33.911002 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.910979    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:33.911002 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.911000    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/13d13392-af25-4d09-bf5b-61ebff79aa9d-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:33.911002 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.911015    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jr95\" (UniqueName: \"kubernetes.io/projected/13d13392-af25-4d09-bf5b-61ebff79aa9d-kube-api-access-4jr95\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:33.911233 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.911028    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/13d13392-af25-4d09-bf5b-61ebff79aa9d-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:33.911233 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.911127    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7274d73d-7890-45bb-981b-f5dfcab8938d" (UID: "7274d73d-7890-45bb-981b-f5dfcab8938d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:47:33.912966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:33.912945    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx" (OuterVolumeSpecName: "kube-api-access-6jkbx") pod "7274d73d-7890-45bb-981b-f5dfcab8938d" (UID: "7274d73d-7890-45bb-981b-f5dfcab8938d"). InnerVolumeSpecName "kube-api-access-6jkbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:47:34.012400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.012322    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7274d73d-7890-45bb-981b-f5dfcab8938d-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:34.012400 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.012348    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jkbx\" (UniqueName: \"kubernetes.io/projected/7274d73d-7890-45bb-981b-f5dfcab8938d-kube-api-access-6jkbx\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:34.301705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.301618    2584 generic.go:356] "Generic (PLEG): container finished" podID="13d13392-af25-4d09-bf5b-61ebff79aa9d" containerID="44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25" exitCode=0
Sep 18 17:47:34.301705 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.301686    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"
Sep 18 17:47:34.301924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.301705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" event={"ID":"13d13392-af25-4d09-bf5b-61ebff79aa9d","Type":"ContainerDied","Data":"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"}
Sep 18 17:47:34.301924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.301781    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg" event={"ID":"13d13392-af25-4d09-bf5b-61ebff79aa9d","Type":"ContainerDied","Data":"e7c29ae3293cbfdcbab23e8493ec9290c5c17dcb1d480f50d11ab53f0304f3df"}
Sep 18 17:47:34.301924 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.301804    2584 scope.go:117] "RemoveContainer" containerID="44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"
Sep 18 17:47:34.303389 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.303366    2584 generic.go:356] "Generic (PLEG): container finished" podID="7274d73d-7890-45bb-981b-f5dfcab8938d" containerID="6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d" exitCode=0
Sep 18 17:47:34.303493 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.303410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" event={"ID":"7274d73d-7890-45bb-981b-f5dfcab8938d","Type":"ContainerDied","Data":"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"}
Sep 18 17:47:34.303493 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.303447    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt" event={"ID":"7274d73d-7890-45bb-981b-f5dfcab8938d","Type":"ContainerDied","Data":"d1429da5005accbbdb50703851cbf88f536261f03b1bc0991184dc20bd25410a"}
Sep 18 17:47:34.303616 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.303597    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"
Sep 18 17:47:34.313637 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.313526    2584 scope.go:117] "RemoveContainer" containerID="44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"
Sep 18 17:47:34.313848 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:47:34.313819    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25\": container with ID starting with 44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25 not found: ID does not exist" containerID="44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"
Sep 18 17:47:34.313966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.313857    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25"} err="failed to get container status \"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25\": rpc error: code = NotFound desc = could not find container \"44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25\": container with ID starting with 44af2f782fad8b585ee4c59d828792b55ed05ff1cb878c6476d41dcc07fc2d25 not found: ID does not exist"
Sep 18 17:47:34.313966 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.313877    2584 scope.go:117] "RemoveContainer" containerID="6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"
Sep 18 17:47:34.322517 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.322500    2584 scope.go:117] "RemoveContainer" containerID="6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"
Sep 18 17:47:34.322796 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:47:34.322778    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d\": container with ID starting with 6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d not found: ID does not exist" containerID="6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"
Sep 18 17:47:34.322837 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.322805    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d"} err="failed to get container status \"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d\": rpc error: code = NotFound desc = could not find container \"6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d\": container with ID starting with 6067c91be81c6cf36bafa7d0e5c128f0cb6b686f609c928e07ba6a9bde634a4d not found: ID does not exist"
Sep 18 17:47:34.329526 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.329507    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:47:34.334773 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.334755    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-88b9e1-5d7654c85c-zp2xg"]
Sep 18 17:47:34.344708 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.344691    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:47:34.348927 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.348907    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-88b9e1-848fbd8d5-rk7wt"]
Sep 18 17:47:34.556771 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.556706    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d13392-af25-4d09-bf5b-61ebff79aa9d" path="/var/lib/kubelet/pods/13d13392-af25-4d09-bf5b-61ebff79aa9d/volumes"
Sep 18 17:47:34.557075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:34.557053    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7274d73d-7890-45bb-981b-f5dfcab8938d" path="/var/lib/kubelet/pods/7274d73d-7890-45bb-981b-f5dfcab8938d/volumes"
Sep 18 17:47:44.051142 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051087    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"]
Sep 18 17:47:44.051715 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051694    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d13392-af25-4d09-bf5b-61ebff79aa9d" containerName="maas-api"
Sep 18 17:47:44.051785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051722    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d13392-af25-4d09-bf5b-61ebff79aa9d" containerName="maas-api"
Sep 18 17:47:44.051785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051767    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7274d73d-7890-45bb-981b-f5dfcab8938d" containerName="payload-processing"
Sep 18 17:47:44.051785 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051777    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7274d73d-7890-45bb-981b-f5dfcab8938d" containerName="payload-processing"
Sep 18 17:47:44.051893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051872    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d13392-af25-4d09-bf5b-61ebff79aa9d" containerName="maas-api"
Sep 18 17:47:44.051893 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.051880    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7274d73d-7890-45bb-981b-f5dfcab8938d" containerName="payload-processing"
Sep 18 17:47:44.056462 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.056444    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:44.059407 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.059383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qt978\""
Sep 18 17:47:44.062630 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.062601    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"]
Sep 18 17:47:44.193515 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.193486    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8\" (UID: \"15c53502-baec-4c73-9223-d5043560de75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:44.294944 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.294906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8\" (UID: \"15c53502-baec-4c73-9223-d5043560de75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:44.295522 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.295503    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8\" (UID: \"15c53502-baec-4c73-9223-d5043560de75\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:44.368072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.368047    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:44.655030 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:44.655001    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"]
Sep 18 17:47:44.656403 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:47:44.656378    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c53502_baec_4c73_9223_d5043560de75.slice/crio-bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f WatchSource:0}: Error finding container bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f: Status 404 returned error can't find the container with id bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f
Sep 18 17:47:45.377058 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:45.377029    2584 generic.go:356] "Generic (PLEG): container finished" podID="15c53502-baec-4c73-9223-d5043560de75" containerID="e5b87632bb4131bf09528a44bfd2056288957b5c68ab99c5bc1ec55c00b61d2d" exitCode=0
Sep 18 17:47:45.377448 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:45.377166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8" event={"ID":"15c53502-baec-4c73-9223-d5043560de75","Type":"ContainerDied","Data":"e5b87632bb4131bf09528a44bfd2056288957b5c68ab99c5bc1ec55c00b61d2d"}
Sep 18 17:47:45.377448 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:45.377276    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8" event={"ID":"15c53502-baec-4c73-9223-d5043560de75","Type":"ContainerStarted","Data":"bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f"}
Sep 18 17:47:46.521201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:46.521174    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:46.612795 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:46.612771    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca\") pod \"15c53502-baec-4c73-9223-d5043560de75\" (UID: \"15c53502-baec-4c73-9223-d5043560de75\") "
Sep 18 17:47:46.613116 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:46.613080    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15c53502-baec-4c73-9223-d5043560de75" (UID: "15c53502-baec-4c73-9223-d5043560de75"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:47:46.714128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:46.714005    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15c53502-baec-4c73-9223-d5043560de75-maas-api-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:47:47.391258 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:47.391223    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"
Sep 18 17:47:47.391418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:47.391256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8" event={"ID":"15c53502-baec-4c73-9223-d5043560de75","Type":"ContainerDied","Data":"bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f"}
Sep 18 17:47:47.391418 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:47.391314    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdbf4b78cda2d0a71a2613d35051ae0ff5bb58cf20b87a952a58ea1f46dc950f"
Sep 18 17:47:59.814090 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:59.814054    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:47:59.814578 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:47:59.814293    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" podUID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" containerName="payload-pre-processing" containerID="cri-o://7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b" gracePeriod=30
Sep 18 17:48:00.048150 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.048086    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"]
Sep 18 17:48:00.053573 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.053547    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-828a86-nmld8"]
Sep 18 17:48:00.077421 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.077364    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:48:00.228437 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.228402    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvxh5\" (UniqueName: \"kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5\") pod \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") "
Sep 18 17:48:00.228629 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.228520    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume\") pod \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\" (UID: \"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4\") "
Sep 18 17:48:00.228839 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.228815    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" (UID: "f1a2075b-adbe-41f8-b6b0-6e4028cddbb4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:48:00.230691 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.230672    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5" (OuterVolumeSpecName: "kube-api-access-tvxh5") pod "f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" (UID: "f1a2075b-adbe-41f8-b6b0-6e4028cddbb4"). InnerVolumeSpecName "kube-api-access-tvxh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:48:00.330045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.329979    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:48:00.330045 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.330005    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvxh5\" (UniqueName: \"kubernetes.io/projected/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4-kube-api-access-tvxh5\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:48:00.477835 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.477802    2584 generic.go:356] "Generic (PLEG): container finished" podID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" containerID="7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b" exitCode=0
Sep 18 17:48:00.477995 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.477851    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"
Sep 18 17:48:00.477995 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.477895    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" event={"ID":"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4","Type":"ContainerDied","Data":"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"}
Sep 18 17:48:00.477995 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.477958    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb" event={"ID":"f1a2075b-adbe-41f8-b6b0-6e4028cddbb4","Type":"ContainerDied","Data":"d19ef67d68d735101cbc640c6844114f8d309b0e4a276606f7958841eb7b87cc"}
Sep 18 17:48:00.477995 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.477987    2584 scope.go:117] "RemoveContainer" containerID="7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"
Sep 18 17:48:00.487457 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.487438    2584 scope.go:117] "RemoveContainer" containerID="7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"
Sep 18 17:48:00.487716 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:48:00.487697    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b\": container with ID starting with 7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b not found: ID does not exist" containerID="7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"
Sep 18 17:48:00.487779 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.487722    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b"} err="failed to get container status \"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b\": rpc error: code = NotFound desc = could not find container \"7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b\": container with ID starting with 7cd991981605942336947ab198fb5983d41429002615b09db3554b877e85a39b not found: ID does not exist"
Sep 18 17:48:00.519640 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.519614    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:48:00.533662 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.533640    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-828a86-7c44bfddcd-9xxfb"]
Sep 18 17:48:00.556814 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.556785    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c53502-baec-4c73-9223-d5043560de75" path="/var/lib/kubelet/pods/15c53502-baec-4c73-9223-d5043560de75/volumes"
Sep 18 17:48:00.557168 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:00.557154    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" path="/var/lib/kubelet/pods/f1a2075b-adbe-41f8-b6b0-6e4028cddbb4/volumes"
Sep 18 17:48:55.861938 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:55.861865    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:48:55.862532 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:48:55.862076    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy" containerID="cri-o://4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112" gracePeriod=30
Sep 18 17:49:01.123210 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.123149    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:49:01.213915 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.213886    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfdnh\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.213919    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.213957    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214010    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214076 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214061    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214097    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214146    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214173    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214209    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket\") pod \"0a3c945a-7a65-44a1-9540-d22157960894\" (UID: \"0a3c945a-7a65-44a1-9540-d22157960894\") "
Sep 18 17:49:01.214331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214314    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:49:01.214581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214508    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:49:01.214581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214533    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:49:01.214581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214520    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.214581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214546    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:49:01.214800 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.214644    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:49:01.216337 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.216312    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh" (OuterVolumeSpecName: "kube-api-access-jfdnh") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "kube-api-access-jfdnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:01.216434 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.216363    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:01.216434 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.216361    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 17:49:01.216564 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.216546    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a3c945a-7a65-44a1-9540-d22157960894" (UID: "0a3c945a-7a65-44a1-9540-d22157960894"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 17:49:01.314910 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314887    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-credential-socket\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314910    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfdnh\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-kube-api-access-jfdnh\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314924    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a3c945a-7a65-44a1-9540-d22157960894-istio-token\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314937    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a3c945a-7a65-44a1-9540-d22157960894-istiod-ca-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314948    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-envoy\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314959    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a3c945a-7a65-44a1-9540-d22157960894-istio-podinfo\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314970    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-workload-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.315014 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.314985    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a3c945a-7a65-44a1-9540-d22157960894-istio-data\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:01.837835 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.837803    2584 generic.go:356] "Generic (PLEG): container finished" podID="0a3c945a-7a65-44a1-9540-d22157960894" containerID="4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112" exitCode=0
Sep 18 17:49:01.837978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.837849    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"
Sep 18 17:49:01.837978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.837890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerDied","Data":"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"}
Sep 18 17:49:01.837978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.837945    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv" event={"ID":"0a3c945a-7a65-44a1-9540-d22157960894","Type":"ContainerDied","Data":"976081cac0a5c55fb17eb720ca111f04c4325d4d7c026ea3db84132fe92d1ebc"}
Sep 18 17:49:01.837978 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.837971    2584 scope.go:117] "RemoveContainer" containerID="4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"
Sep 18 17:49:01.847892 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.847877    2584 scope.go:117] "RemoveContainer" containerID="1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"
Sep 18 17:49:01.856484 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.856462    2584 scope.go:117] "RemoveContainer" containerID="4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"
Sep 18 17:49:01.856739 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:01.856720    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112\": container with ID starting with 4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112 not found: ID does not exist" containerID="4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"
Sep 18 17:49:01.856797 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.856748    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112"} err="failed to get container status \"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112\": rpc error: code = NotFound desc = could not find container \"4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112\": container with ID starting with 4c41de9bd5e684dbc51ffb49fe5303ea3faa8996a1c99aabf7926518c5438112 not found: ID does not exist"
Sep 18 17:49:01.856797 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.856765    2584 scope.go:117] "RemoveContainer" containerID="1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"
Sep 18 17:49:01.857017 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:01.856998    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d\": container with ID starting with 1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d not found: ID does not exist" containerID="1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"
Sep 18 17:49:01.857061 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.857023    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d"} err="failed to get container status \"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d\": rpc error: code = NotFound desc = could not find container \"1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d\": container with ID starting with 1db0752a875ce9c1da7a8b4773ea8df05497214f76f85242deea195761836c4d not found: ID does not exist"
Sep 18 17:49:01.866331 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.866307    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:49:01.882745 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:01.882715    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-828a86-openshift-default-7746bcc4d-z52rv"]
Sep 18 17:49:02.556684 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:02.556653    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3c945a-7a65-44a1-9540-d22157960894" path="/var/lib/kubelet/pods/0a3c945a-7a65-44a1-9540-d22157960894/volumes"
Sep 18 17:49:06.974890 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:06.974860    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:49:06.975385 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:06.975086    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" podUID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" containerName="payload-processing" containerID="cri-o://65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254" gracePeriod=30
Sep 18 17:49:07.230003 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.229947    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:49:07.363265 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.363230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p6rc\" (UniqueName: \"kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc\") pod \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") "
Sep 18 17:49:07.363441 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.363301    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume\") pod \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\" (UID: \"6e6b36d2-a287-4555-8d8e-004b9f694b1f\") "
Sep 18 17:49:07.363707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.363677    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e6b36d2-a287-4555-8d8e-004b9f694b1f" (UID: "6e6b36d2-a287-4555-8d8e-004b9f694b1f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:49:07.365619 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.365593    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc" (OuterVolumeSpecName: "kube-api-access-6p6rc") pod "6e6b36d2-a287-4555-8d8e-004b9f694b1f" (UID: "6e6b36d2-a287-4555-8d8e-004b9f694b1f"). InnerVolumeSpecName "kube-api-access-6p6rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:07.464826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.464799    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p6rc\" (UniqueName: \"kubernetes.io/projected/6e6b36d2-a287-4555-8d8e-004b9f694b1f-kube-api-access-6p6rc\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:07.464826 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.464824    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b36d2-a287-4555-8d8e-004b9f694b1f-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:07.875535 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.875496    2584 generic.go:356] "Generic (PLEG): container finished" podID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" containerID="65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254" exitCode=0
Sep 18 17:49:07.875738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.875541    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"
Sep 18 17:49:07.875738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.875577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" event={"ID":"6e6b36d2-a287-4555-8d8e-004b9f694b1f","Type":"ContainerDied","Data":"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"}
Sep 18 17:49:07.875738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.875631    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829" event={"ID":"6e6b36d2-a287-4555-8d8e-004b9f694b1f","Type":"ContainerDied","Data":"79ba8b0c8245c42e6d9a614f09c3a07080a77525b9d56846b5692c9c0c9ffdca"}
Sep 18 17:49:07.875738 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.875657    2584 scope.go:117] "RemoveContainer" containerID="65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"
Sep 18 17:49:07.885419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.885399    2584 scope.go:117] "RemoveContainer" containerID="65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"
Sep 18 17:49:07.885668 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:07.885646    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254\": container with ID starting with 65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254 not found: ID does not exist" containerID="65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"
Sep 18 17:49:07.885717 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.885678    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254"} err="failed to get container status \"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254\": rpc error: code = NotFound desc = could not find container \"65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254\": container with ID starting with 65a5363be7ad36d9ec5e803b59cf6cebf50ea69b76796e42beb3484f5071c254 not found: ID does not exist"
Sep 18 17:49:07.900935 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.900909    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:49:07.903762 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:07.903738    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8bdd6-76467b6589-gx829"]
Sep 18 17:49:08.556250 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:08.556216    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" path="/var/lib/kubelet/pods/6e6b36d2-a287-4555-8d8e-004b9f694b1f/volumes"
Sep 18 17:49:25.471415 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.471380    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:49:25.472010 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.471585    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" podUID="c260257c-14e8-4c4c-814e-15e58d956edf" containerName="payload-pre-processing" containerID="cri-o://d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90" gracePeriod=30
Sep 18 17:49:25.732125 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.732057    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:49:25.794225 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.794187    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wtqc\" (UniqueName: \"kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc\") pod \"c260257c-14e8-4c4c-814e-15e58d956edf\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") "
Sep 18 17:49:25.794419 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.794255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume\") pod \"c260257c-14e8-4c4c-814e-15e58d956edf\" (UID: \"c260257c-14e8-4c4c-814e-15e58d956edf\") "
Sep 18 17:49:25.794651 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.794623    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c260257c-14e8-4c4c-814e-15e58d956edf" (UID: "c260257c-14e8-4c4c-814e-15e58d956edf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:49:25.796627 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.796603    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc" (OuterVolumeSpecName: "kube-api-access-7wtqc") pod "c260257c-14e8-4c4c-814e-15e58d956edf" (UID: "c260257c-14e8-4c4c-814e-15e58d956edf"). InnerVolumeSpecName "kube-api-access-7wtqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:25.895722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.895684    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wtqc\" (UniqueName: \"kubernetes.io/projected/c260257c-14e8-4c4c-814e-15e58d956edf-kube-api-access-7wtqc\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:25.895722 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.895723    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c260257c-14e8-4c4c-814e-15e58d956edf-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:25.978082 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.978045    2584 generic.go:356] "Generic (PLEG): container finished" podID="c260257c-14e8-4c4c-814e-15e58d956edf" containerID="d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90" exitCode=0
Sep 18 17:49:25.978289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.978129    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" event={"ID":"c260257c-14e8-4c4c-814e-15e58d956edf","Type":"ContainerDied","Data":"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"}
Sep 18 17:49:25.978289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.978146    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"
Sep 18 17:49:25.978289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.978214    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2" event={"ID":"c260257c-14e8-4c4c-814e-15e58d956edf","Type":"ContainerDied","Data":"bbe5013f99d4ddc264c2962e5bc6256e54cae9d5e8e146572b5d934f5f47129f"}
Sep 18 17:49:25.978289 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.978245    2584 scope.go:117] "RemoveContainer" containerID="d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"
Sep 18 17:49:25.991359 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.991333    2584 scope.go:117] "RemoveContainer" containerID="d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"
Sep 18 17:49:25.991653 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:25.991631    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90\": container with ID starting with d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90 not found: ID does not exist" containerID="d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"
Sep 18 17:49:25.991736 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:25.991670    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90"} err="failed to get container status \"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90\": rpc error: code = NotFound desc = could not find container \"d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90\": container with ID starting with d3beaba370aeb7a0b63a6512678d4af37e0550cfa54a7c295cf65cffb8933b90 not found: ID does not exist"
Sep 18 17:49:26.009132 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:26.009068    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:49:26.014906 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:26.014882    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-eeab6e-6cd8944ddb-x6sh2"]
Sep 18 17:49:26.557221 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:26.557194    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c260257c-14e8-4c4c-814e-15e58d956edf" path="/var/lib/kubelet/pods/c260257c-14e8-4c4c-814e-15e58d956edf/volumes"
Sep 18 17:49:28.719075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:28.719047    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:49:28.724746 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:28.724728    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:49:43.648442 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.648408    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"]
Sep 18 17:49:43.654263 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.654235    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-808470-29829225-lwwxx"]
Sep 18 17:49:43.685021 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.684995    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:49:43.685249 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.685224    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" podUID="a29bf793-a5e9-4d60-a005-28a42898b80b" containerName="payload-processing" containerID="cri-o://e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea" gracePeriod=30
Sep 18 17:49:43.691436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.691409    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:49:43.691653 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.691615    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" podUID="b7b0b474-5307-47c5-ac17-e162003fd599" containerName="payload-pre-processing" containerID="cri-o://f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3" gracePeriod=30
Sep 18 17:49:43.970038 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.970011    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:49:43.973146 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:43.973125    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:49:44.039707 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.039676    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume\") pod \"b7b0b474-5307-47c5-ac17-e162003fd599\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") "
Sep 18 17:49:44.039869 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.039777    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drxl5\" (UniqueName: \"kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5\") pod \"b7b0b474-5307-47c5-ac17-e162003fd599\" (UID: \"b7b0b474-5307-47c5-ac17-e162003fd599\") "
Sep 18 17:49:44.039869 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.039819    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume\") pod \"a29bf793-a5e9-4d60-a005-28a42898b80b\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") "
Sep 18 17:49:44.039967 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.039869    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8cp2\" (UniqueName: \"kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2\") pod \"a29bf793-a5e9-4d60-a005-28a42898b80b\" (UID: \"a29bf793-a5e9-4d60-a005-28a42898b80b\") "
Sep 18 17:49:44.040212 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.040182    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7b0b474-5307-47c5-ac17-e162003fd599" (UID: "b7b0b474-5307-47c5-ac17-e162003fd599"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:49:44.040318 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.040245    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a29bf793-a5e9-4d60-a005-28a42898b80b" (UID: "a29bf793-a5e9-4d60-a005-28a42898b80b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:49:44.041973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.041954    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5" (OuterVolumeSpecName: "kube-api-access-drxl5") pod "b7b0b474-5307-47c5-ac17-e162003fd599" (UID: "b7b0b474-5307-47c5-ac17-e162003fd599"). InnerVolumeSpecName "kube-api-access-drxl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:44.042162 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.042130    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2" (OuterVolumeSpecName: "kube-api-access-d8cp2") pod "a29bf793-a5e9-4d60-a005-28a42898b80b" (UID: "a29bf793-a5e9-4d60-a005-28a42898b80b"). InnerVolumeSpecName "kube-api-access-d8cp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:44.085317 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.085281    2584 generic.go:356] "Generic (PLEG): container finished" podID="a29bf793-a5e9-4d60-a005-28a42898b80b" containerID="e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea" exitCode=0
Sep 18 17:49:44.085426 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.085316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" event={"ID":"a29bf793-a5e9-4d60-a005-28a42898b80b","Type":"ContainerDied","Data":"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"}
Sep 18 17:49:44.085426 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.085337    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"
Sep 18 17:49:44.085426 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.085373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl" event={"ID":"a29bf793-a5e9-4d60-a005-28a42898b80b","Type":"ContainerDied","Data":"03f7ef040013f2413463899040e3c76aca33949ada6e1e728049ac00590f6a1e"}
Sep 18 17:49:44.085426 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.085402    2584 scope.go:117] "RemoveContainer" containerID="e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"
Sep 18 17:49:44.087477 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.087455    2584 generic.go:356] "Generic (PLEG): container finished" podID="b7b0b474-5307-47c5-ac17-e162003fd599" containerID="f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3" exitCode=0
Sep 18 17:49:44.087617 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.087510    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" event={"ID":"b7b0b474-5307-47c5-ac17-e162003fd599","Type":"ContainerDied","Data":"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"}
Sep 18 17:49:44.087617 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.087554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl" event={"ID":"b7b0b474-5307-47c5-ac17-e162003fd599","Type":"ContainerDied","Data":"35c6dac2c576158d4a21bb0ecdbe22e4ebc362a8c14cb1a8f4fc17b27dc9ca9a"}
Sep 18 17:49:44.087617 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.087514    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"
Sep 18 17:49:44.095366 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.095341    2584 scope.go:117] "RemoveContainer" containerID="e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"
Sep 18 17:49:44.095686 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:44.095665    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea\": container with ID starting with e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea not found: ID does not exist" containerID="e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"
Sep 18 17:49:44.095770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.095690    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea"} err="failed to get container status \"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea\": rpc error: code = NotFound desc = could not find container \"e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea\": container with ID starting with e7c8f073977cff40bee27ac7c4b81db38c43345942d394417d8cfac72bfbd0ea not found: ID does not exist"
Sep 18 17:49:44.095770 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.095708    2584 scope.go:117] "RemoveContainer" containerID="f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"
Sep 18 17:49:44.103775 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.103759    2584 scope.go:117] "RemoveContainer" containerID="f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"
Sep 18 17:49:44.104023 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:44.104005    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3\": container with ID starting with f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3 not found: ID does not exist" containerID="f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"
Sep 18 17:49:44.104072 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.104029    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3"} err="failed to get container status \"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3\": rpc error: code = NotFound desc = could not find container \"f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3\": container with ID starting with f4f1696eead97dabc06a9508cec70d6cd912273c2b3cd7d46f6c2a8fdfa7f1d3 not found: ID does not exist"
Sep 18 17:49:44.110607 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.110588    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:49:44.114734 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.114713    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-808470-77cdd8d9c5-vl6hl"]
Sep 18 17:49:44.125422 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.125403    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:49:44.130425 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.130405    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-808470-c64775f74-44ckl"]
Sep 18 17:49:44.141383 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.141361    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8cp2\" (UniqueName: \"kubernetes.io/projected/a29bf793-a5e9-4d60-a005-28a42898b80b-kube-api-access-d8cp2\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:44.141383 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.141382    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7b0b474-5307-47c5-ac17-e162003fd599-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:44.141513 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.141393    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drxl5\" (UniqueName: \"kubernetes.io/projected/b7b0b474-5307-47c5-ac17-e162003fd599-kube-api-access-drxl5\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:44.141513 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.141401    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a29bf793-a5e9-4d60-a005-28a42898b80b-plugins-config-volume\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:44.562616 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.562583    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43cd640a-9587-4f51-a77e-5be1eea8c1ab" path="/var/lib/kubelet/pods/43cd640a-9587-4f51-a77e-5be1eea8c1ab/volumes"
Sep 18 17:49:44.562920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.562906    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a29bf793-a5e9-4d60-a005-28a42898b80b" path="/var/lib/kubelet/pods/a29bf793-a5e9-4d60-a005-28a42898b80b/volumes"
Sep 18 17:49:44.563236 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:44.563223    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b0b474-5307-47c5-ac17-e162003fd599" path="/var/lib/kubelet/pods/b7b0b474-5307-47c5-ac17-e162003fd599/volumes"
Sep 18 17:49:55.439041 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.438988    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:49:55.439638 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.439320    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-744bfff48d-zskc2" podUID="e3bbeab9-e355-488a-af08-28adc2b5eefd" containerName="manager" containerID="cri-o://966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191" gracePeriod=30
Sep 18 17:49:55.689776 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.689708    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:49:55.734128 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.734075    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert\") pod \"e3bbeab9-e355-488a-af08-28adc2b5eefd\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") "
Sep 18 17:49:55.734330 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.734159    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs\") pod \"e3bbeab9-e355-488a-af08-28adc2b5eefd\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") "
Sep 18 17:49:55.734330 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.734264    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6tcn\" (UniqueName: \"kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn\") pod \"e3bbeab9-e355-488a-af08-28adc2b5eefd\" (UID: \"e3bbeab9-e355-488a-af08-28adc2b5eefd\") "
Sep 18 17:49:55.736556 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.736521    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e3bbeab9-e355-488a-af08-28adc2b5eefd" (UID: "e3bbeab9-e355-488a-af08-28adc2b5eefd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:49:55.736730 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.736621    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn" (OuterVolumeSpecName: "kube-api-access-n6tcn") pod "e3bbeab9-e355-488a-af08-28adc2b5eefd" (UID: "e3bbeab9-e355-488a-af08-28adc2b5eefd"). InnerVolumeSpecName "kube-api-access-n6tcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:49:55.736824 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.736799    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e3bbeab9-e355-488a-af08-28adc2b5eefd" (UID: "e3bbeab9-e355-488a-af08-28adc2b5eefd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:49:55.835147 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.835085    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-webhook-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:55.835147 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.835138    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3bbeab9-e355-488a-af08-28adc2b5eefd-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:55.835147 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:55.835147    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6tcn\" (UniqueName: \"kubernetes.io/projected/e3bbeab9-e355-488a-af08-28adc2b5eefd-kube-api-access-n6tcn\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:49:56.167517 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.167458    2584 generic.go:356] "Generic (PLEG): container finished" podID="e3bbeab9-e355-488a-af08-28adc2b5eefd" containerID="966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191" exitCode=0
Sep 18 17:49:56.167841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.167563    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zskc2" event={"ID":"e3bbeab9-e355-488a-af08-28adc2b5eefd","Type":"ContainerDied","Data":"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"}
Sep 18 17:49:56.167841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.167589    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zskc2"
Sep 18 17:49:56.167841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.167684    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zskc2" event={"ID":"e3bbeab9-e355-488a-af08-28adc2b5eefd","Type":"ContainerDied","Data":"0c85b3baf1494b24bf14d9d6d984a9f4f1c5fa3447c393cd8c3587ab21cda4da"}
Sep 18 17:49:56.167841 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.167726    2584 scope.go:117] "RemoveContainer" containerID="966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"
Sep 18 17:49:56.182088 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.182063    2584 scope.go:117] "RemoveContainer" containerID="966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"
Sep 18 17:49:56.182599 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:49:56.182565    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191\": container with ID starting with 966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191 not found: ID does not exist" containerID="966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"
Sep 18 17:49:56.182656 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.182620    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191"} err="failed to get container status \"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191\": rpc error: code = NotFound desc = could not find container \"966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191\": container with ID starting with 966bf5b37ddd9ea0cf245ab0bee4a9817b912fd8715cb9906b43c26ecd645191 not found: ID does not exist"
Sep 18 17:49:56.194574 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.194539    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:49:56.198827 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.198801    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zskc2"]
Sep 18 17:49:56.556778 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:49:56.556693    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3bbeab9-e355-488a-af08-28adc2b5eefd" path="/var/lib/kubelet/pods/e3bbeab9-e355-488a-af08-28adc2b5eefd/volumes"
Sep 18 17:50:56.984840 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.984801    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985185    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c260257c-14e8-4c4c-814e-15e58d956edf" containerName="payload-pre-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985199    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c260257c-14e8-4c4c-814e-15e58d956edf" containerName="payload-pre-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985212    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b0b474-5307-47c5-ac17-e162003fd599" containerName="payload-pre-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985221    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b0b474-5307-47c5-ac17-e162003fd599" containerName="payload-pre-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985234    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3bbeab9-e355-488a-af08-28adc2b5eefd" containerName="manager"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985241    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3bbeab9-e355-488a-af08-28adc2b5eefd" containerName="manager"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985252    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985258    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985273    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" containerName="payload-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985282    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" containerName="payload-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985292    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985297    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985303    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29bf793-a5e9-4d60-a005-28a42898b80b" containerName="payload-processing"
Sep 18 17:50:56.985301 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985308    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29bf793-a5e9-4d60-a005-28a42898b80b" containerName="payload-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985320    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" containerName="payload-pre-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985326    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" containerName="payload-pre-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985332    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c53502-baec-4c73-9223-d5043560de75" containerName="revoke-keys"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985337    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c53502-baec-4c73-9223-d5043560de75" containerName="revoke-keys"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985391    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985400    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b0b474-5307-47c5-ac17-e162003fd599" containerName="payload-pre-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985407    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3bbeab9-e355-488a-af08-28adc2b5eefd" containerName="manager"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985412    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6b36d2-a287-4555-8d8e-004b9f694b1f" containerName="payload-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985418    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3c945a-7a65-44a1-9540-d22157960894" containerName="istio-proxy"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985423    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1a2075b-adbe-41f8-b6b0-6e4028cddbb4" containerName="payload-pre-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985429    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c260257c-14e8-4c4c-814e-15e58d956edf" containerName="payload-pre-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985435    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29bf793-a5e9-4d60-a005-28a42898b80b" containerName="payload-processing"
Sep 18 17:50:56.985759 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.985440    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c53502-baec-4c73-9223-d5043560de75" containerName="revoke-keys"
Sep 18 17:50:56.988298 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.988281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:56.991074 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.991052    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 17:50:56.991404 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.991389    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 17:50:56.992347 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.992324    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 17:50:56.992347 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:56.992342    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vwjqg\""
Sep 18 17:50:57.003769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.003743    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:50:57.026973 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.026940    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.027088 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.027031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.027204 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.027119    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm79f\" (UniqueName: \"kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.127877 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.127838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.128046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.127910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.128046 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.127963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm79f\" (UniqueName: \"kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.130512 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.130486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.130512 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.130509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.137315 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.137293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm79f\" (UniqueName: \"kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f\") pod \"maas-controller-744bfff48d-qs26d\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") " pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.299253 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.299152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:57.584810 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.584786    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:50:57.586927 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:50:57.586897    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f61ae2e_db7a_49be_b4b7_510fdd5b4132.slice/crio-8ed27d1a055d42d6dceca6f8a36c45d202aadf18ff73dd99c0b01431d8073764 WatchSource:0}: Error finding container 8ed27d1a055d42d6dceca6f8a36c45d202aadf18ff73dd99c0b01431d8073764: Status 404 returned error can't find the container with id 8ed27d1a055d42d6dceca6f8a36c45d202aadf18ff73dd99c0b01431d8073764
Sep 18 17:50:57.588646 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:57.588619    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 17:50:58.501712 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:58.501607    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-qs26d" event={"ID":"9f61ae2e-db7a-49be-b4b7-510fdd5b4132","Type":"ContainerStarted","Data":"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"}
Sep 18 17:50:58.501712 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:58.501662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-qs26d" event={"ID":"9f61ae2e-db7a-49be-b4b7-510fdd5b4132","Type":"ContainerStarted","Data":"8ed27d1a055d42d6dceca6f8a36c45d202aadf18ff73dd99c0b01431d8073764"}
Sep 18 17:50:58.501712 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:58.501684    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:50:58.530341 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:50:58.530281    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744bfff48d-qs26d" podStartSLOduration=1.896770442 podStartE2EDuration="2.530264555s" totalImagesPullingTime="633.494113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:50:58.528304246 +0000 UTC m=+2190.470561856" watchObservedRunningTime="2026-09-18 17:50:58.530264555 +0000 UTC m=+2190.472522164"
Sep 18 17:51:09.509608 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:09.509580    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:51:16.824581 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:16.824542    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:51:16.825095 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:16.824731    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-744bfff48d-qs26d" podUID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" containerName="manager" containerID="cri-o://a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a" gracePeriod=30
Sep 18 17:51:17.067740 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.067715    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:51:17.205025 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.204983    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs\") pod \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") "
Sep 18 17:51:17.205239 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.205035    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert\") pod \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") "
Sep 18 17:51:17.205239 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.205072    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lm79f\" (UniqueName: \"kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f\") pod \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\" (UID: \"9f61ae2e-db7a-49be-b4b7-510fdd5b4132\") "
Sep 18 17:51:17.207469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.207430    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9f61ae2e-db7a-49be-b4b7-510fdd5b4132" (UID: "9f61ae2e-db7a-49be-b4b7-510fdd5b4132"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:51:17.207469 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.207451    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9f61ae2e-db7a-49be-b4b7-510fdd5b4132" (UID: "9f61ae2e-db7a-49be-b4b7-510fdd5b4132"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:51:17.207634 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.207455    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f" (OuterVolumeSpecName: "kube-api-access-lm79f") pod "9f61ae2e-db7a-49be-b4b7-510fdd5b4132" (UID: "9f61ae2e-db7a-49be-b4b7-510fdd5b4132"). InnerVolumeSpecName "kube-api-access-lm79f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:51:17.306801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.306766    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:51:17.306801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.306796    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-webhook-cert\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:51:17.306801 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.306806    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lm79f\" (UniqueName: \"kubernetes.io/projected/9f61ae2e-db7a-49be-b4b7-510fdd5b4132-kube-api-access-lm79f\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:51:17.604943 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.604907    2584 generic.go:356] "Generic (PLEG): container finished" podID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" containerID="a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a" exitCode=0
Sep 18 17:51:17.605175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.604950    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-qs26d" event={"ID":"9f61ae2e-db7a-49be-b4b7-510fdd5b4132","Type":"ContainerDied","Data":"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"}
Sep 18 17:51:17.605175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.604954    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-qs26d"
Sep 18 17:51:17.605175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.604987    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-qs26d" event={"ID":"9f61ae2e-db7a-49be-b4b7-510fdd5b4132","Type":"ContainerDied","Data":"8ed27d1a055d42d6dceca6f8a36c45d202aadf18ff73dd99c0b01431d8073764"}
Sep 18 17:51:17.605175 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.605009    2584 scope.go:117] "RemoveContainer" containerID="a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"
Sep 18 17:51:17.614960 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.614943    2584 scope.go:117] "RemoveContainer" containerID="a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"
Sep 18 17:51:17.615243 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:51:17.615220    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a\": container with ID starting with a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a not found: ID does not exist" containerID="a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"
Sep 18 17:51:17.615344 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.615252    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a"} err="failed to get container status \"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a\": rpc error: code = NotFound desc = could not find container \"a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a\": container with ID starting with a9f8299a13d2acc4f0c46d7407354fe9b06ec1cedddcee6812409cdb471a4b4a not found: ID does not exist"
Sep 18 17:51:17.635075 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.635039    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:51:17.649401 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:17.649370    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-744bfff48d-qs26d"]
Sep 18 17:51:18.559170 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.559099    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" path="/var/lib/kubelet/pods/9f61ae2e-db7a-49be-b4b7-510fdd5b4132/volumes"
Sep 18 17:51:18.711515 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.711482    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-744bfff48d-zt7gb"]
Sep 18 17:51:18.711851 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.711838    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" containerName="manager"
Sep 18 17:51:18.711905 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.711854    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" containerName="manager"
Sep 18 17:51:18.711950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.711936    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f61ae2e-db7a-49be-b4b7-510fdd5b4132" containerName="manager"
Sep 18 17:51:18.716259 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.716237    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.721950 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.721927    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 18 17:51:18.722091 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.721954    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vwjqg\""
Sep 18 17:51:18.722091 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.721926    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 18 17:51:18.722091 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.721926    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 18 17:51:18.736145 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.736099    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zt7gb"]
Sep 18 17:51:18.820754 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.820660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt8ft\" (UniqueName: \"kubernetes.io/projected/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-kube-api-access-bt8ft\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.820754 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.820712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-webhook-cert\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.820754 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.820730    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-metrics-certs\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.921305 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.921265    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt8ft\" (UniqueName: \"kubernetes.io/projected/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-kube-api-access-bt8ft\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.921470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.921326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-webhook-cert\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.921470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.921345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-metrics-certs\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.924023 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.923988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-webhook-cert\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.924193 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.924051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-metrics-certs\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:18.932166 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:18.932142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt8ft\" (UniqueName: \"kubernetes.io/projected/cbfbe10b-b938-4ddb-b8c7-1e880ce863b4-kube-api-access-bt8ft\") pod \"maas-controller-744bfff48d-zt7gb\" (UID: \"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4\") " pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:19.026784 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:19.026754    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:19.310372 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:19.310346    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-744bfff48d-zt7gb"]
Sep 18 17:51:19.310485 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:51:19.310458    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfbe10b_b938_4ddb_b8c7_1e880ce863b4.slice/crio-00039c04df134eaa3770a8c84558b340f8db4baf170fd91956828d6cde6d6539 WatchSource:0}: Error finding container 00039c04df134eaa3770a8c84558b340f8db4baf170fd91956828d6cde6d6539: Status 404 returned error can't find the container with id 00039c04df134eaa3770a8c84558b340f8db4baf170fd91956828d6cde6d6539
Sep 18 17:51:19.618942 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:19.618908    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zt7gb" event={"ID":"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4","Type":"ContainerStarted","Data":"00039c04df134eaa3770a8c84558b340f8db4baf170fd91956828d6cde6d6539"}
Sep 18 17:51:20.625595 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:20.625554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-744bfff48d-zt7gb" event={"ID":"cbfbe10b-b938-4ddb-b8c7-1e880ce863b4","Type":"ContainerStarted","Data":"3261c63f22be3c1735fe9142a2e22351dc2ca19618d473d5dbe17a9fe2ea8b4d"}
Sep 18 17:51:20.626057 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:20.625617    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:51:20.656302 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:20.656237    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-744bfff48d-zt7gb" podStartSLOduration=2.181513794 podStartE2EDuration="2.656220812s" totalImagesPullingTime="474.707018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:51:20.65301695 +0000 UTC m=+2212.595274614" watchObservedRunningTime="2026-09-18 17:51:20.656220812 +0000 UTC m=+2212.598478454"
Sep 18 17:51:28.859552 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:28.859518    2584 scope.go:117] "RemoveContainer" containerID="3bf8c83f32977ea7d58603ad77004caace7c60c74c1f035860a2e618fb2af291"
Sep 18 17:51:31.633426 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:51:31.633389    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-744bfff48d-zt7gb"
Sep 18 17:54:28.758926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:54:28.758893    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:54:28.765548 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:54:28.765527    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f9mxp_f4b5fc06-218e-4769-a9f6-2b5e38768741/ovn-acl-logging/0.log"
Sep 18 17:54:28.899069 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:54:28.899041    2584 scope.go:117] "RemoveContainer" containerID="e5b87632bb4131bf09528a44bfd2056288957b5c68ab99c5bc1ec55c00b61d2d"
Sep 18 17:55:35.669876 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.669838    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"]
Sep 18 17:55:35.673222 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.673205    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.676554 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.676535    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sjtq4\""
Sep 18 17:55:35.686625 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.686599    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"]
Sep 18 17:55:35.771243 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.771205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g5xv\" (UniqueName: \"kubernetes.io/projected/1f9638a6-971c-4b20-9bf5-14fca9e0d337-kube-api-access-2g5xv\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.771409 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.771253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-maas-api-tls\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.771409 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.771289    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9638a6-971c-4b20-9bf5-14fca9e0d337-openshift-service-ca\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.771409 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.771374    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-metrics-certs\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.872097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.872062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g5xv\" (UniqueName: \"kubernetes.io/projected/1f9638a6-971c-4b20-9bf5-14fca9e0d337-kube-api-access-2g5xv\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.872097 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.872129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-maas-api-tls\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.872384 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.872163    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9638a6-971c-4b20-9bf5-14fca9e0d337-openshift-service-ca\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.872384 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.872236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-metrics-certs\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.873088 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.873056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9638a6-971c-4b20-9bf5-14fca9e0d337-openshift-service-ca\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.875055 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.875028    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-metrics-certs\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.875055 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.875050    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9638a6-971c-4b20-9bf5-14fca9e0d337-maas-api-tls\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.882099 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.882062    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g5xv\" (UniqueName: \"kubernetes.io/projected/1f9638a6-971c-4b20-9bf5-14fca9e0d337-kube-api-access-2g5xv\") pod \"maas-api-78bfb4b689-n4rgx\" (UID: \"1f9638a6-971c-4b20-9bf5-14fca9e0d337\") " pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:35.983816 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:35.983756    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:36.286474 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:36.281172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"]
Sep 18 17:55:36.981445 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:36.981410    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx" event={"ID":"1f9638a6-971c-4b20-9bf5-14fca9e0d337","Type":"ContainerStarted","Data":"7fa701d3ec0050158eeb3898e7f6f4fb41220d890ccb2ba917128602fc66fff2"}
Sep 18 17:55:36.981861 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:36.981468    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx" event={"ID":"1f9638a6-971c-4b20-9bf5-14fca9e0d337","Type":"ContainerStarted","Data":"0fbcdfdfe327d68c33c518f53b8a6fe8e6004ade3fcb8820549ecfe7037cebd2"}
Sep 18 17:55:36.981861 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:36.981520    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:37.011970 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:37.011931    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx" podStartSLOduration=1.487559311 podStartE2EDuration="2.011918787s" totalImagesPullingTime="524.359476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 17:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:55:37.009335442 +0000 UTC m=+2468.951593069" watchObservedRunningTime="2026-09-18 17:55:37.011918787 +0000 UTC m=+2468.954176395"
Sep 18 17:55:42.992376 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:42.992349    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-78bfb4b689-n4rgx"
Sep 18 17:55:43.053561 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:43.053522    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:55:43.053788 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:43.053740    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerName="maas-api" containerID="cri-o://577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2" gracePeriod=30
Sep 18 17:55:44.189716 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.189681    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.37:8443/health\": dial tcp 10.132.0.37:8443: connect: connection refused"
Sep 18 17:55:44.301933 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.301910    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:55:44.434926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.434859    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc6dn\" (UniqueName: \"kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn\") pod \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") "
Sep 18 17:55:44.434926 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.434890    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") pod \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") "
Sep 18 17:55:44.435151 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.434942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs\") pod \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") "
Sep 18 17:55:44.435151 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.434981    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca\") pod \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\" (UID: \"297f09c9-d51c-4101-8bb1-201fb77aa0fc\") "
Sep 18 17:55:44.435436 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.435404    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "297f09c9-d51c-4101-8bb1-201fb77aa0fc" (UID: "297f09c9-d51c-4101-8bb1-201fb77aa0fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 17:55:44.437278 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.437245    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "297f09c9-d51c-4101-8bb1-201fb77aa0fc" (UID: "297f09c9-d51c-4101-8bb1-201fb77aa0fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:55:44.437405 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.437355    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "297f09c9-d51c-4101-8bb1-201fb77aa0fc" (UID: "297f09c9-d51c-4101-8bb1-201fb77aa0fc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 17:55:44.437482 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.437446    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn" (OuterVolumeSpecName: "kube-api-access-bc6dn") pod "297f09c9-d51c-4101-8bb1-201fb77aa0fc" (UID: "297f09c9-d51c-4101-8bb1-201fb77aa0fc"). InnerVolumeSpecName "kube-api-access-bc6dn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 17:55:44.535965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.535941    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-metrics-certs\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:55:44.535965 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.535963    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/297f09c9-d51c-4101-8bb1-201fb77aa0fc-openshift-service-ca\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:55:44.536173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.535972    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc6dn\" (UniqueName: \"kubernetes.io/projected/297f09c9-d51c-4101-8bb1-201fb77aa0fc-kube-api-access-bc6dn\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:55:44.536173 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:44.535980    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/297f09c9-d51c-4101-8bb1-201fb77aa0fc-maas-api-tls\") on node \"ip-10-0-135-187.ec2.internal\" DevicePath \"\""
Sep 18 17:55:45.026753 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.026715    2584 generic.go:356] "Generic (PLEG): container finished" podID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerID="577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2" exitCode=0
Sep 18 17:55:45.026920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.026768    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"
Sep 18 17:55:45.026920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.026801    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" event={"ID":"297f09c9-d51c-4101-8bb1-201fb77aa0fc","Type":"ContainerDied","Data":"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"}
Sep 18 17:55:45.026920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.026868    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc" event={"ID":"297f09c9-d51c-4101-8bb1-201fb77aa0fc","Type":"ContainerDied","Data":"f8c05fc4ac87ff221dd6324fb1a97b7b54a39d9f16d689381237058f0a65eabd"}
Sep 18 17:55:45.026920 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.026893    2584 scope.go:117] "RemoveContainer" containerID="577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"
Sep 18 17:55:45.036288 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.036262    2584 scope.go:117] "RemoveContainer" containerID="577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"
Sep 18 17:55:45.036613 ip-10-0-135-187 kubenswrapper[2584]: E0918 17:55:45.036576    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2\": container with ID starting with 577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2 not found: ID does not exist" containerID="577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"
Sep 18 17:55:45.036704 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.036618    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2"} err="failed to get container status \"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2\": rpc error: code = NotFound desc = could not find container \"577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2\": container with ID starting with 577268420a95d37099af771903b37f09c8ffac5697cff78e1226c435b4fdbbb2 not found: ID does not exist"
Sep 18 17:55:45.049318 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.049294    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:55:45.056339 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:45.056317    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7dc567d6f7-8kjzc"]
Sep 18 17:55:46.556954 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:55:46.556916    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" path="/var/lib/kubelet/pods/297f09c9-d51c-4101-8bb1-201fb77aa0fc/volumes"
Sep 18 17:56:07.230508 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:07.230477    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-744bfff48d-zt7gb_cbfbe10b-b938-4ddb-b8c7-1e880ce863b4/manager/0.log"
Sep 18 17:56:07.346311 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:07.346248    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hqczm_347bd51b-88ca-4434-ab79-875850d7c1f9/server/0.log"
Sep 18 17:56:07.460358 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:07.460335    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m92wv_34ea59d6-1fd9-402b-b72f-bf8f7f83fa61/manager/0.log"
Sep 18 17:56:07.579361 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:07.579333    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9496889b9-7j846_800632a6-1776-4a22-9219-1c4b39447041/manager/0.log"
Sep 18 17:56:07.585854 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:07.585833    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9496889b9-7j846_800632a6-1776-4a22-9219-1c4b39447041/copy-manifests/0.log"
Sep 18 17:56:08.144849 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:08.144821    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-78bfb4b689-n4rgx_1f9638a6-971c-4b20-9bf5-14fca9e0d337/maas-api/0.log"
Sep 18 17:56:08.575161 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:08.575065    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tsrwb_e9891fc7-5541-4bce-98c2-8a7b28e5f6a5/postgres/0.log"
Sep 18 17:56:09.470089 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:09.470057    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-72zvd_cfd653f7-415e-4ae1-9400-65f68a37273b/manager/0.log"
Sep 18 17:56:10.502121 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:10.502071    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jx694_156ac9cd-3b85-4041-bbc8-083d9b413b04/discovery/0.log"
Sep 18 17:56:10.709205 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:10.709177    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b7cd5988-rcw5z_43faafad-12eb-4d3b-99d9-0a7e6aed62b2/kube-auth-proxy/0.log"
Sep 18 17:56:10.830874 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:10.830802    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/1.log"
Sep 18 17:56:10.945036 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:10.945010    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dlvwq_02b00979-6994-470a-bc52-47d72d624dcb/payload-pre-processing/0.log"
Sep 18 17:56:11.068655 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:11.068633    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"
Sep 18 17:56:11.555032 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:11.555007    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lbzmd_ea2bcb8f-09a5-4db7-8efb-21b2ae3d9696/main/0.log"
Sep 18 17:56:11.932458 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:11.932434    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vd6mp_59731c97-8eff-4279-ae92-a24a5df19134/main/0.log"
Sep 18 17:56:12.197092 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:12.197019    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-wk89f_1f97a132-c159-4cac-bff2-a0c349ca091f/main/0.log"
Sep 18 17:56:21.458151 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:21.458069    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7f5hp_f73c23a6-fd1e-4a2d-a9d1-3468c4fa0662/global-pull-secret-syncer/0.log"
Sep 18 17:56:21.909057 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:21.909028    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w4ph9_c0e49a0b-5a57-42df-8083-78563bf3056f/konnectivity-agent/0.log"
Sep 18 17:56:22.022470 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:22.022447    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-187.ec2.internal_517bf25c721df95130fe87564d9fa154/haproxy/0.log"
Sep 18 17:56:26.259720 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:26.259688    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-72zvd_cfd653f7-415e-4ae1-9400-65f68a37273b/manager/0.log"
Sep 18 17:56:28.484077 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:28.484046    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8lth_83dd1def-794e-43f2-ab7f-b7a63c26c0d1/node-exporter/0.log"
Sep 18 17:56:28.512856 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:28.512831    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8lth_83dd1def-794e-43f2-ab7f-b7a63c26c0d1/kube-rbac-proxy/0.log"
Sep 18 17:56:28.535929 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:28.535908    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g8lth_83dd1def-794e-43f2-ab7f-b7a63c26c0d1/init-textfile/0.log"
Sep 18 17:56:31.522360 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.522324    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"]
Sep 18 17:56:31.522868 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.522848    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerName="maas-api"
Sep 18 17:56:31.522943 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.522871    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerName="maas-api"
Sep 18 17:56:31.523000 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.522969    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="297f09c9-d51c-4101-8bb1-201fb77aa0fc" containerName="maas-api"
Sep 18 17:56:31.527364 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.527344    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.530201 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.530178    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbl54\"/\"openshift-service-ca.crt\""
Sep 18 17:56:31.530299 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.530226    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xbl54\"/\"kube-root-ca.crt\""
Sep 18 17:56:31.531303 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.531285    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xbl54\"/\"default-dockercfg-222tl\""
Sep 18 17:56:31.549065 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.549037    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"]
Sep 18 17:56:31.613234 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.613209    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-lib-modules\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.613338 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.613247    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24b8w\" (UniqueName: \"kubernetes.io/projected/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-kube-api-access-24b8w\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.613338 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.613263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-sys\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.613457 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.613384    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-proc\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.613457 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.613422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-podres\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713734 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-proc\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713734 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-podres\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713876 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-lib-modules\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713876 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24b8w\" (UniqueName: \"kubernetes.io/projected/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-kube-api-access-24b8w\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-proc\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-podres\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713926    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-lib-modules\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.713989 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.713945    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-sys\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.714181 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.714043    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-sys\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.729330 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.729307    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24b8w\" (UniqueName: \"kubernetes.io/projected/9e9113e9-f8d1-46b9-aaed-67abec5c28c2-kube-api-access-24b8w\") pod \"perf-node-gather-daemonset-dwv4l\" (UID: \"9e9113e9-f8d1-46b9-aaed-67abec5c28c2\") " pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:31.836881 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:31.836836    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:32.132066 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:32.132040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"]
Sep 18 17:56:32.133285 ip-10-0-135-187 kubenswrapper[2584]: W0918 17:56:32.133255    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e9113e9_f8d1_46b9_aaed_67abec5c28c2.slice/crio-d256586a417d56df411aef118940a4e083bd32fcb1a287bbf2b02dd0a619cf7a WatchSource:0}: Error finding container d256586a417d56df411aef118940a4e083bd32fcb1a287bbf2b02dd0a619cf7a: Status 404 returned error can't find the container with id d256586a417d56df411aef118940a4e083bd32fcb1a287bbf2b02dd0a619cf7a
Sep 18 17:56:32.275828 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:32.275789    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l" event={"ID":"9e9113e9-f8d1-46b9-aaed-67abec5c28c2","Type":"ContainerStarted","Data":"af3b1b68dd6a6d57bf220d5c816bb0f6d0b34ef6af2bd250f532c2c44781d7e8"}
Sep 18 17:56:32.275928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:32.275848    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l" event={"ID":"9e9113e9-f8d1-46b9-aaed-67abec5c28c2","Type":"ContainerStarted","Data":"d256586a417d56df411aef118940a4e083bd32fcb1a287bbf2b02dd0a619cf7a"}
Sep 18 17:56:32.275928 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:32.275903    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:32.314349 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:32.314304    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l" podStartSLOduration=1.314289949 podStartE2EDuration="1.314289949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 17:56:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 17:56:32.313524085 +0000 UTC m=+2524.255781692" watchObservedRunningTime="2026-09-18 17:56:32.314289949 +0000 UTC m=+2524.256547556"
Sep 18 17:56:33.368170 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:33.368143    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-l24tk_fbd2c2f6-8d0e-4f27-98e1-d464ebcf4ef7/volume-data-source-validator/0.log"
Sep 18 17:56:34.505689 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:34.505663    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88mkm_6a1dd53a-cf41-4b05-971b-73025c85bd6e/dns/0.log"
Sep 18 17:56:34.543789 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:34.543766    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-88mkm_6a1dd53a-cf41-4b05-971b-73025c85bd6e/kube-rbac-proxy/0.log"
Sep 18 17:56:34.832525 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:34.832447    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pd2vh_d617eb0a-3bb5-40c9-90e4-b246d680118e/dns-node-resolver/0.log"
Sep 18 17:56:35.718849 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:35.718814    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2f7l9_93cd3e32-f0f3-44f3-9cfd-4bb6e687cb55/node-ca/0.log"
Sep 18 17:56:37.472284 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.472250    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jx694_156ac9cd-3b85-4041-bbc8-083d9b413b04/discovery/0.log"
Sep 18 17:56:37.626350 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.626315    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b7cd5988-rcw5z_43faafad-12eb-4d3b-99d9-0a7e6aed62b2/kube-auth-proxy/0.log"
Sep 18 17:56:37.697798 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.697767    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/0.log"
Sep 18 17:56:37.700369 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.700348    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/1.log"
Sep 18 17:56:37.747873 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.747761    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dlvwq_02b00979-6994-470a-bc52-47d72d624dcb/payload-pre-processing/0.log"
Sep 18 17:56:37.794129 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:37.792678    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"
Sep 18 17:56:38.290769 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:38.290735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xbl54/perf-node-gather-daemonset-dwv4l"
Sep 18 17:56:38.839796 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:38.839757    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bj4hc_2d3d4997-1dcc-4594-8afc-5419330730ec/serve-healthcheck-canary/0.log"
Sep 18 17:56:39.796281 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:39.796247    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w7s9_fb9640f9-2535-48d9-b744-fa921e4ed9b6/kube-rbac-proxy/0.log"
Sep 18 17:56:39.832009 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:39.831980    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w7s9_fb9640f9-2535-48d9-b744-fa921e4ed9b6/exporter/0.log"
Sep 18 17:56:39.871129 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:39.871087    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7w7s9_fb9640f9-2535-48d9-b744-fa921e4ed9b6/extractor/0.log"
Sep 18 17:56:41.828490 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.828460    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jx694_156ac9cd-3b85-4041-bbc8-083d9b413b04/discovery/0.log"
Sep 18 17:56:41.860001 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.859977    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b7cd5988-rcw5z_43faafad-12eb-4d3b-99d9-0a7e6aed62b2/kube-auth-proxy/0.log"
Sep 18 17:56:41.881932 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.881906    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/0.log"
Sep 18 17:56:41.884507 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.884486    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/1.log"
Sep 18 17:56:41.907514 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.907486    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dlvwq_02b00979-6994-470a-bc52-47d72d624dcb/payload-pre-processing/0.log"
Sep 18 17:56:41.931733 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:41.931705    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"
Sep 18 17:56:43.160165 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.160136    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-744bfff48d-zt7gb_cbfbe10b-b938-4ddb-b8c7-1e880ce863b4/manager/0.log"
Sep 18 17:56:43.194608 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.194583    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-hqczm_347bd51b-88ca-4434-ab79-875850d7c1f9/server/0.log"
Sep 18 17:56:43.280521 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.280493    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m92wv_34ea59d6-1fd9-402b-b72f-bf8f7f83fa61/manager/0.log"
Sep 18 17:56:43.331606 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.331579    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9496889b9-7j846_800632a6-1776-4a22-9219-1c4b39447041/manager/0.log"
Sep 18 17:56:43.421310 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.421249    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9496889b9-7j846_800632a6-1776-4a22-9219-1c4b39447041/copy-manifests/0.log"
Sep 18 17:56:43.972914 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:43.972881    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jx694_156ac9cd-3b85-4041-bbc8-083d9b413b04/discovery/0.log"
Sep 18 17:56:44.035402 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:44.035374    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65b7cd5988-rcw5z_43faafad-12eb-4d3b-99d9-0a7e6aed62b2/kube-auth-proxy/0.log"
Sep 18 17:56:44.058333 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:44.058310    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/0.log"
Sep 18 17:56:44.061024 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:44.060994    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vwcxb_a7a80669-9995-405b-83c2-af950b822e12/istio-proxy/1.log"
Sep 18 17:56:44.082150 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:44.082099    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-dlvwq_02b00979-6994-470a-bc52-47d72d624dcb/payload-pre-processing/0.log"
Sep 18 17:56:44.104942 ip-10-0-135-187 kubenswrapper[2584]: I0918 17:56:44.104918    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-vjmzj_059e94b8-4d64-4d01-b298-dd9801ded22b/payload-processing/0.log"