Sep 17 23:04:12.882726 ip-10-0-133-33 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 23:04:12.882734 ip-10-0-133-33 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 23:04:12.882741 ip-10-0-133-33 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 23:04:12.882880 ip-10-0-133-33 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 23:04:23.050931 ip-10-0-133-33 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 23:04:23.050951 ip-10-0-133-33 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0cc6d15b8fd24e24922ba8b48efc5654 --
Sep 17 23:06:01.026335 ip-10-0-133-33 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 23:06:01.428826 ip-10-0-133-33 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:01.428826 ip-10-0-133-33 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 23:06:01.428826 ip-10-0-133-33 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:01.428826 ip-10-0-133-33 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 23:06:01.428826 ip-10-0-133-33 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 23:06:01.429884 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.429796    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 23:06:01.436453 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436428    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.436453 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436448    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.436453 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436454    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.436453 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436458    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436461    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436469    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436476    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436480    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436484    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436488    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436492    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436496    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436501    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436505    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436509    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436512    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436516    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436520    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436524    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436528    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436531    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436535    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.436708 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436539    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436549    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436553    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436557    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436561    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436564    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436569    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436573    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436576    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436580    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436584    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436589    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436593    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436597    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436602    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436607    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436611    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436616    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436620    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436624    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436628    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.437581 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436632    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436636    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436641    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436645    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436649    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436653    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436657    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436663    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436667    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436671    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436675    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436679    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436683    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436690    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436694    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436699    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436703    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436707    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436710    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436714    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.438489 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436718    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436723    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436727    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436731    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436736    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436740    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436746    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436750    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436755    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436759    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436763    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436768    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436772    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436776    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436784    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436791    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436795    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436800    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436804    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.439334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436810    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436816    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436822    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436827    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436832    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436836    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436840    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436845    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436849    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436853    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436857    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436862    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436866    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436871    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436875    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436879    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.436883    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438123    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438137    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438144    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.440154 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438149    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438153    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438158    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438163    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438167    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438171    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438176    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438180    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438185    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438189    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438192    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438197    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438201    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438205    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438210    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438215    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438219    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438223    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438227    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438231    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.440998 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438236    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438240    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438244    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438248    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438253    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438257    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438261    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438266    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438273    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438278    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438283    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438289    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438295    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438299    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438304    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438312    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438318    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438323    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438327    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.441645 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438332    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438336    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438341    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438345    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438349    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438353    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438357    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438361    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438367    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438371    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438375    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438380    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438384    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438389    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438393    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438397    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438402    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438406    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438412    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438418    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.442198 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438423    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438427    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438432    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438437    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438442    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438446    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438450    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438454    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438458    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438462    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438466    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438471    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438475    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438480    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438484    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438487    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438493    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438497    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438500    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.442723 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438504    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438508    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438513    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438517    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438521    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438530    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438535    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438539    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438543    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438549    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438553    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438557    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438561    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438566    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438570    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438574    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438578    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.438583    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439240    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.443232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439253    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439259    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439264    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439268    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439273    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439278    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439282    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439287    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439291    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439298    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439304    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439309    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439314    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439319    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439323    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439328    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439333    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439336    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439343    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.443688 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439347    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439351    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439355    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439360    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439365    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439369    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439374    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439378    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439382    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439386    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439390    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439394    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439398    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439404    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439409    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439413    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439417    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439421    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439425    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439430    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.444425 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439434    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439437    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439441    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439445    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439450    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439454    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439458    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439462    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439467    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439471    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439476    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439483    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439487    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439492    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439496    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439501    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439505    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439512    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439517    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.444912 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439521    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439525    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439529    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439533    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439537    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439542    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439546    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439550    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439555    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439561    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439565    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439569    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439573    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439578    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439582    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439586    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439591    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439595    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439599    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439603    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.445384 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439607    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439611    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439615    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439620    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439627    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439631    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439635    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439639    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439644    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439648    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439652    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439656    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439661    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439666    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439669    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439674    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439678    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439682    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439686    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.439691    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439800    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 23:06:01.446007 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439851    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439862    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439869    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439874    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439880    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439886    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439893    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439898    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439903    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439908    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439914    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439919    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439924    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439928    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439933    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439941    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439946    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439952    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439957    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439963    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439967    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439973    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439979    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 23:06:01.446536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439984    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439989    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439994    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.439999    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440004    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440009    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440014    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440019    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440025    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440030    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440035    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440040    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440063    2581 flags.go:64] FLAG: --enable-server="true"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440068    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440076    2581 flags.go:64] FLAG: --event-burst="100"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440081    2581 flags.go:64] FLAG: --event-qps="50"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440086    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440091    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440096    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440102    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440109    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440114    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440119    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440123    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440130    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 23:06:01.447127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440135    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440140    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440145    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440149    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440153    2581 flags.go:64] FLAG: --feature-gates=""
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440165    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440170    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440174    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440179    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440184    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440190    2581 flags.go:64] FLAG: --help="false"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440194    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440199    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440204    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440209    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440214    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440220    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440225    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440230    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440234    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440239    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440244    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440249    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440254    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 17 23:06:01.447773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440258    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440263    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440268    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440276    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440281    2581 flags.go:64] FLAG: --lock-file=""
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440285    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440290    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440295    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440304    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440309    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440314    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440319    2581 flags.go:64] FLAG: --logging-format="text"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440324    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440329    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440334    2581 flags.go:64] FLAG: --manifest-url=""
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440338    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440345    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440349    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440355    2581 flags.go:64] FLAG: --max-pods="110"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440360    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440365    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440370    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440374    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440379    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440384    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 23:06:01.448394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440389    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440400    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440405    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440410    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440415    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440420    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440428    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440433    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440437    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440442    2581 flags.go:64] FLAG: --port="10250"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440449    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440453    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8111156dc2fca6a"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440459    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440464    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440468    2581 flags.go:64] FLAG: --register-node="true"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440473    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440479    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440485    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440490    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440495    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440501    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440505    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440510    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440515    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440519    2581 flags.go:64] FLAG: --runonce="false"
Sep 17 23:06:01.449074 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440524    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440529    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440534    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440539    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440544    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440548    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440553    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440558    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440563    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440569    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440573    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440578    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440583    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440587    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440592    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440601    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440605    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440612    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440618    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440622    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440627    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440632    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440637    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440642    2581 flags.go:64] FLAG: --v="2"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440648    2581 flags.go:64] FLAG: --version="false"
Sep 17 23:06:01.449696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440655    2581 flags.go:64] FLAG: --vmodule=""
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440661    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.440667    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440839    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440846    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440850    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440855    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440859    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440864    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440868    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440872    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440876    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440880    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440884    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440889    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440893    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440897    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440901    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440905    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440910    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.450331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440914    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440918    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440922    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440926    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440933    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440937    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440941    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440945    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440949    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440954    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440958    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440962    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440966    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440971    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440975    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440979    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440984    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440988    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440992    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.440996    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.450839 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441003    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441008    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441014    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441018    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441024    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441028    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441032    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441037    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441041    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441065    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441071    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441076    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441082    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441088    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441092    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441097    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441103    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441108    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441112    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.451354 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441116    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441120    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441126    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441130    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441135    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441139    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441144    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441149    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441153    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441158    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441161    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441166    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441170    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441174    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441179    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441183    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441187    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441192    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441196    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441200    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.451820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441204    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441209    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441213    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441217    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441221    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441226    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441230    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441234    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441238    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441245    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441249    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441253    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441258    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441262    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441268    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441272    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441276    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441280    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441284    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441289    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.452338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441294    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441299    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.441303    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.442038    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.450304    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.450317    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.451231    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.451239    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451291    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451296    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451299    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451304    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451308    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451311    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451314    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.452821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451316    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451319    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451322    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451324    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451327    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451330    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451332    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451335    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451338    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451341    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451343    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451346    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451349    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451351    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451354    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451358    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451360    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451364    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451367    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451370    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.453217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451372    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451376    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451379    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451382    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451384    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451387    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451390    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451393    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451396    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451398    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451401    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451404    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451406    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451409    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451412    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451414    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451417    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451420    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451422    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451425    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.453692 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451428    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451430    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451433    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451435    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451438    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451440    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451443    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451446    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451448    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451451    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451454    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451457    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451459    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451462    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451465    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451467    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451470    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451472    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451475    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451477    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.454235 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451480    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451482    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451485    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451487    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451490    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451492    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451495    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451500    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451503    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451506    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451509    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451512    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451514    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451518    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451521    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451524    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451527    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451531    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451533    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.454725 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451536    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451539    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451542    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451545    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451548    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451551    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451554    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451557    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451560    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451563    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451566    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451568    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451571    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.451576    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451684    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 23:06:01.455208 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451688    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451691    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451695    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451699    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451702    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451705    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451708    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451711    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451713    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451716    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451719    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451721    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451724    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451726    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451729    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451732    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451735    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451738    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451740    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451743    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 23:06:01.455569 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451746    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451749    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451752    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451754    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451757    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451760    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451762    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451765    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451768    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451770    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451773    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451776    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451778    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451781    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451783    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451786    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451788    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451791    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451793    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 23:06:01.456124 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451796    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451799    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451801    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451804    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451806    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451809    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451812    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451814    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451817    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451820    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451823    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451825    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451828    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451830    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451833    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451836    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451839    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451842    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451844    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451847    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 23:06:01.456588 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451850    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451852    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451855    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451859    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451862    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451864    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451867    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451870    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451873    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451876    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451878    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451881    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451883    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451886    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451889    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451892    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451894    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451897    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451899    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 23:06:01.457106 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451902    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451904    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451907    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451910    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451912    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451915    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451917    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451920    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451922    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451925    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451929    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451932    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451935    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451937    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451940    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451943    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451945    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451948    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451950    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 23:06:01.457566 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:01.451953    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.451958    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.452075    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.454411    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.455517    2581 server.go:1019] "Starting client certificate rotation"
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.455618    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 23:06:01.458061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.455652    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 23:06:01.458472 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.458458    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 23:06:01.460078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.460061    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 23:06:01.472693 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.471646    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 17 23:06:01.476634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.476615    2581 log.go:25] "Validated CRI v1 image API"
Sep 17 23:06:01.477490 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.477472    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 23:06:01.480825 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.480806    2581 fs.go:135] Filesystem UUIDs: map[3c15df92-b4b6-4413-80c5-9ced9698b1ca:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c0f677e6-1217-40b2-8893-f069d7163a29:/dev/nvme0n1p3]
Sep 17 23:06:01.480874 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.480826    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 23:06:01.486015 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.485887    2581 manager.go:216] Machine: {Timestamp:2026-09-17 23:06:01.484431611 +0000 UTC m=+0.362946848 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111519 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cbd22d66dbb8d49ea7fea1a8caa4 SystemUUID:ec20cbd2-2d66-dbb8-d49e-a7fea1a8caa4 BootID:0cc6d15b-8fd2-4e24-922b-a8b48efc5654 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f9:44:53:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f9:44:53:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:7b:e0:cd:7a:fb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 23:06:01.486015 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.486009    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 23:06:01.486142 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.486101    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 23:06:01.486708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.486692    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 23:06:01.487944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.487918    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 23:06:01.488085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.487947    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 23:06:01.488801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.488790    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 23:06:01.488801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.488802    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 23:06:01.488868 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.488809    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 23:06:01.489751 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.489741    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 23:06:01.489819 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.489811    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 23:06:01.495239 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495227    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 23:06:01.495349 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495339    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 23:06:01.495386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495368    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 23:06:01.495386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495377    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 23:06:01.495457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495388    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 23:06:01.495457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495398    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 17 23:06:01.495457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495406    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 23:06:01.495781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495769    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 23:06:01.495822 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.495787    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 23:06:01.498187 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.498171    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 17 23:06:01.500997 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.500981    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 23:06:01.501075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.501012    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 23:06:01.502431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502419    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502435    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502441    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502447    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502456    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502463    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502477    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 23:06:01.502480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502482    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 23:06:01.502679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502488    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 23:06:01.502679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502494    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 23:06:01.502679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502508    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 23:06:01.502679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.502514    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 23:06:01.503280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.503267    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 23:06:01.503312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.503283    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 23:06:01.507283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.507269    2581 server.go:1268] "Started kubelet"
Sep 17 23:06:01.507370 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.507347    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 23:06:01.507424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.507351    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 23:06:01.507424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.507421    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 23:06:01.508113 ip-10-0-133-33 systemd[1]: Started Kubernetes Kubelet.
Sep 17 23:06:01.509194 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.508907    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 23:06:01.509194 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.509059    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 23:06:01.509271 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.509207    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 23:06:01.510649 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.509733    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 23:06:01.513290 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.513168    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 23:06:01.514700 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.514669    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 23:06:01.516944 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.515864    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-33.ec2.internal.18d63e437d00160a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-33.ec2.internal,UID:ip-10-0-133-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-33.ec2.internal,},FirstTimestamp:2026-09-17 23:06:01.507239434 +0000 UTC m=+0.385754670,LastTimestamp:2026-09-17 23:06:01.507239434 +0000 UTC m=+0.385754670,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-33.ec2.internal,}"
Sep 17 23:06:01.521823 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.521792    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 23:06:01.522423 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.522408    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 23:06:01.522521 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.522498    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:01.523272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523250    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 23:06:01.523272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523255    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 23:06:01.523272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523265    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 23:06:01.523437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523250    2581 factory.go:55] Registering systemd factory
Sep 17 23:06:01.523437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523318    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 17 23:06:01.523437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523363    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 23:06:01.523437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523371    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 23:06:01.523573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523506    2581 factory.go:153] Registering CRI-O factory
Sep 17 23:06:01.523573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523515    2581 factory.go:223] Registration of the crio container factory successfully
Sep 17 23:06:01.523573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523551    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 23:06:01.523573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523564    2581 factory.go:103] Registering Raw factory
Sep 17 23:06:01.523573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.523574    2581 manager.go:1196] Started watching for new ooms in manager
Sep 17 23:06:01.524569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.524551    2581 manager.go:349] Starting recovery of all containers
Sep 17 23:06:01.527243 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.527206    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 23:06:01.527321 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.527283    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 23:06:01.536134 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.535975    2581 manager.go:354] Recovery completed
Sep 17 23:06:01.538693 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.538671    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lx9z"
Sep 17 23:06:01.539979 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.539967    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.541582 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.541566    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.541672 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.541595    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.541672 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.541608    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.542178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542163    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 23:06:01.542178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542172    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.542284 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542174    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 23:06:01.542284 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542215    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 23:06:01.542806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542792    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.542863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542816    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.542863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.542825    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.543438 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.543373    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-33.ec2.internal.18d63e437f0c13c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-33.ec2.internal,UID:ip-10-0-133-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-33.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-33.ec2.internal,},FirstTimestamp:2026-09-17 23:06:01.541579713 +0000 UTC m=+0.420094956,LastTimestamp:2026-09-17 23:06:01.541579713 +0000 UTC m=+0.420094956,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-33.ec2.internal,}"
Sep 17 23:06:01.544513 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.544377    2581 policy_none.go:49] "None policy: Start"
Sep 17 23:06:01.544513 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.544516    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 23:06:01.544650 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.544531    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 23:06:01.546290 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.546274    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lx9z"
Sep 17 23:06:01.548268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.548255    2581 policy_none.go:47] "Start"
Sep 17 23:06:01.580686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.580671    2581 manager.go:337] "Starting Device Plugin manager"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.580714    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.580726    2581 server.go:87] "Starting device plugin registration server"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.581012    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.581022    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.581097    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.581185    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.581194    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.581830    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 23:06:01.601660 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.581882    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:01.652770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.652745    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 23:06:01.653867 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.653852    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 23:06:01.653941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.653898    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 23:06:01.653941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.653918    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 23:06:01.654064 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.654009    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 23:06:01.656406 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.656387    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:01.681548 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.681478    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.682378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.682362    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.682446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.682391    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.682446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.682400    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.682446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.682422    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.691242 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.691227    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.691288 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.691246    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-33.ec2.internal\": node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:01.730100 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.730080    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:01.754275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.754255    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"]
Sep 17 23:06:01.754350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.754320    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.755161 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.755144    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.755252 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.755174    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.755252 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.755184    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.757510 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.757498    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.757626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.757611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.757703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.757645    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.758197 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758179    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.758299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758179    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.758299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758249    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.758299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758210    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.758299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758267    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.758299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.758275    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.760514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.760498    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.760582 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.760523    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 23:06:01.761200 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.761185    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 23:06:01.761279 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.761208    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 23:06:01.761279 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.761218    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeHasSufficientPID"
Sep 17 23:06:01.793586 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.793566    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-33.ec2.internal\" not found" node="ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.798122 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.798104    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-33.ec2.internal\" not found" node="ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.825796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.825777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.825876 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.825801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.825876 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.825817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1921d7596feedc2338fdc3de110f547-config\") pod \"kube-apiserver-proxy-ip-10-0-133-33.ec2.internal\" (UID: \"f1921d7596feedc2338fdc3de110f547\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.830288 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.830274    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:01.926409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.926409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.926528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1921d7596feedc2338fdc3de110f547-config\") pod \"kube-apiserver-proxy-ip-10-0-133-33.ec2.internal\" (UID: \"f1921d7596feedc2338fdc3de110f547\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.926528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.926528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f1921d7596feedc2338fdc3de110f547-config\") pod \"kube-apiserver-proxy-ip-10-0-133-33.ec2.internal\" (UID: \"f1921d7596feedc2338fdc3de110f547\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.926528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:01.926507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/08b8577d582e483569f5b31aa0c4b233-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal\" (UID: \"08b8577d582e483569f5b31aa0c4b233\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:01.930496 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:01.930479    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:02.031320 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.031262    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:02.097462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.097440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:02.101620 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.101604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:02.132212 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.132190    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:02.232713 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.232679    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:02.333496 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.333439    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-33.ec2.internal\" not found"
Sep 17 23:06:02.406732 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.406709    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:02.423913 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.423893    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:02.433783 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.433762    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 23:06:02.435273 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.435256    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal"
Sep 17 23:06:02.447105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.447087    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 23:06:02.455417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.455402    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 23:06:02.455523 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.455501    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 23:06:02.455565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.455502    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 23:06:02.495709 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.495683    2581 apiserver.go:52] "Watching apiserver"
Sep 17 23:06:02.512041 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.512020    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 23:06:02.512343 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.512323    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9bc9s","kube-system/konnectivity-agent-vq4xx","kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal","openshift-dns/node-resolver-hzxrn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal","openshift-multus/multus-4bh9x","openshift-multus/multus-additional-cni-plugins-s7kvw","openshift-multus/network-metrics-daemon-mm4gc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m","openshift-cluster-node-tuning-operator/tuned-5gpgf","openshift-image-registry/node-ca-f4x8q","openshift-network-diagnostics/network-check-target-bmwfh","openshift-network-operator/iptables-alerter-tb57t","openshift-ovn-kubernetes/ovnkube-node-pjvw9"]
Sep 17 23:06:02.514888 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.514873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.517087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.517065    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.517185 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.517098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-52fs4\""
Sep 17 23:06:02.517185 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.517136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.517185 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.517147    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.520130 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.520108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.520718 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.520703    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4kjgr\""
Sep 17 23:06:02.521254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.521239    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 23:06:02.521317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.521265    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 23:06:02.522034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.522022    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 23:06:02.522260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.522242    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 23:06:02.522350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.522284    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.522350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.522335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.522789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.522772    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-77wxj\""
Sep 17 23:06:02.523460 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.523439    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 23:06:02.523460 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.523448    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.523610 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.523506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 23:06:02.523610 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.523451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 23:06:02.524317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.524302    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.524431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.524411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.524518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.524504    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cr9qc\""
Sep 17 23:06:02.524619 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.524604    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.524749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.524734    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 23:06:02.526797 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.526783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.527171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dx72d\""
Sep 17 23:06:02.527171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527152    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 23:06:02.527311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 23:06:02.527311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527255    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.527311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527256    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.527419 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.527367    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 23:06:02.529041 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.529027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.529182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.529155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv5r5\""
Sep 17 23:06:02.530642 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530621    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 23:06:02.530711 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-sys\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.530711 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-tuned\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.530820 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-slash\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530820 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-etc-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530820 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-bin\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5956530-c1d2-4a28-9fb6-01eb44512b32-host\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5956530-c1d2-4a28-9fb6-01eb44512b32-serviceca\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-kubelet\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-systemd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.530945 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-var-lib-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.530974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-config\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dttzv\" (UniqueName: \"kubernetes.io/projected/f5956530-c1d2-4a28-9fb6-01eb44512b32-kube-api-access-dttzv\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-lib-modules\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-systemd-units\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.531209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-modprobe-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-systemd\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-ovn\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-netd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-cnibin\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-kubernetes\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a36f5855-8bb2-4208-87b9-ab66292212a3-agent-certs\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a36f5855-8bb2-4208-87b9-ab66292212a3-konnectivity-ca\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-netns\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531453    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-script-lib\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531514    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pt6wz\""
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531527    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531539    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysconfig\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-run\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.531616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-host\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7tsf\" (UniqueName: \"kubernetes.io/projected/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-kube-api-access-q7tsf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-node-log\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-log-socket\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-conf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-tmp\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-env-overrides\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a63b706-c845-4ece-81a0-4968cae1fe75-ovn-node-metrics-cert\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-var-lib-kubelet\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531894    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffq5f\" (UniqueName: \"kubernetes.io/projected/5a63b706-c845-4ece-81a0-4968cae1fe75-kube-api-access-ffq5f\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-system-cni-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.532199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.531923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84v8j\" (UniqueName: \"kubernetes.io/projected/2f43e326-7d27-4547-931f-3b25540b849e-kube-api-access-84v8j\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.532745 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.532582    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 23:06:02.533622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.533603    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 23:06:02.533739 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.533721    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.533821 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.533801    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:02.533872 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.533725    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.534151 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.534133    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.534248 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.534138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hqpvp\""
Sep 17 23:06:02.536103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.536083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.538491 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.538472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:02.538569 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.538538    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:02.538673 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.538654    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 23:06:02.538673 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.538680    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hqrmh\""
Sep 17 23:06:02.538829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.538728    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 23:06:02.541294 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.541277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.541381 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.541330    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:02.553124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.553085    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 23:01:01 +0000 UTC" deadline="2028-03-29 17:18:08.970652962 +0000 UTC"
Sep 17 23:06:02.553124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.553123    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13410h12m6.417533591s"
Sep 17 23:06:02.560973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.560753    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q54rt"
Sep 17 23:06:02.570075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.570000    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q54rt"
Sep 17 23:06:02.624309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.624288    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 23:06:02.633034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-k8s-cni-cncf-io\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.633125 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-bin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.633125 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-script-lib\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.633195 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.633195 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.633263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-daemon-config\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.633263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjl67\" (UniqueName: \"kubernetes.io/projected/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-kube-api-access-rjl67\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.633263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-kubelet-config\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.633369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysconfig\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.633369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633294    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-run\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.633369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-node-log\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.633369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysconfig\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.633369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-log-socket\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-dbus\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-node-log\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633409    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-log-socket\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-sys-fs\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-run\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-system-cni-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.633568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633535    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84v8j\" (UniqueName: \"kubernetes.io/projected/2f43e326-7d27-4547-931f-3b25540b849e-kube-api-access-84v8j\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-cnibin\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-sys\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-slash\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-script-lib\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-slash\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633665    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5956530-c1d2-4a28-9fb6-01eb44512b32-host\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-sys\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-cnibin\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-multus-certs\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-tmp-dir\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f5956530-c1d2-4a28-9fb6-01eb44512b32-host\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw2vh\" (UniqueName: \"kubernetes.io/projected/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-kube-api-access-hw2vh\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.634086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-lib-modules\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-system-cni-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cnibin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-lib-modules\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-kubelet\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.633995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-binary-copy\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-modprobe-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634009    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-ovn\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634102    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f43e326-7d27-4547-931f-3b25540b849e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634145    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-ovn\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-modprobe-d\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-netd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-netd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f4f09-3fe6-49a6-9562-1549de6dddb2-host-slash\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.634618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-kubernetes\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634353    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f43e326-7d27-4547-931f-3b25540b849e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a36f5855-8bb2-4208-87b9-ab66292212a3-agent-certs\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a36f5855-8bb2-4208-87b9-ab66292212a3-konnectivity-ca\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-kubernetes\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-netns\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-socket-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-host\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7tsf\" (UniqueName: \"kubernetes.io/projected/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-kube-api-access-q7tsf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-multus\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-conf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-tmp\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-env-overrides\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a63b706-c845-4ece-81a0-4968cae1fe75-ovn-node-metrics-cert\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sr4q\" (UniqueName: \"kubernetes.io/projected/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kube-api-access-6sr4q\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-var-lib-kubelet\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634664    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffq5f\" (UniqueName: \"kubernetes.io/projected/5a63b706-c845-4ece-81a0-4968cae1fe75-kube-api-access-ffq5f\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-socket-dir-parent\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-netns\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-hostroot\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-conf-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dttzv\" (UniqueName: \"kubernetes.io/projected/f5956530-c1d2-4a28-9fb6-01eb44512b32-kube-api-access-dttzv\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634871    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srw9m\" (UniqueName: \"kubernetes.io/projected/bba79b0b-9db3-4ab5-90db-9881c2898a54-kube-api-access-srw9m\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-run-netns\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a36f5855-8bb2-4208-87b9-ab66292212a3-konnectivity-ca\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-system-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-tuned\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.634989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-etc-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-bin\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5956530-c1d2-4a28-9fb6-01eb44512b32-serviceca\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-kubelet\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.635864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-systemd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-var-lib-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-config\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz47m\" (UniqueName: \"kubernetes.io/projected/047f4f09-3fe6-49a6-9562-1549de6dddb2-kube-api-access-qz47m\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-etc-kubernetes\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635226    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-cni-bin\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-run-systemd\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-host\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-var-lib-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f5956530-c1d2-4a28-9fb6-01eb44512b32-serviceca\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-host-kubelet\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-registration-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-systemd-units\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f4f09-3fe6-49a6-9562-1549de6dddb2-iptables-alerter-script\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cni-binary-copy\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.637280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-device-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-env-overrides\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635893    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-hosts-file\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a63b706-c845-4ece-81a0-4968cae1fe75-ovnkube-config\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-systemd\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-etc-openvswitch\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.635992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a63b706-c845-4ece-81a0-4968cae1fe75-systemd-units\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.636039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-systemd\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.636108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-var-lib-kubelet\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.636206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-sysctl-conf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638174 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.638155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-tmp\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.638167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a63b706-c845-4ece-81a0-4968cae1fe75-ovn-node-metrics-cert\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.638566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.638250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-etc-tuned\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.638566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.638368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a36f5855-8bb2-4208-87b9-ab66292212a3-agent-certs\") pod \"konnectivity-agent-vq4xx\" (UID: \"a36f5855-8bb2-4208-87b9-ab66292212a3\") " pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.640735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.640717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84v8j\" (UniqueName: \"kubernetes.io/projected/2f43e326-7d27-4547-931f-3b25540b849e-kube-api-access-84v8j\") pod \"multus-additional-cni-plugins-s7kvw\" (UID: \"2f43e326-7d27-4547-931f-3b25540b849e\") " pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.644942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.644920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dttzv\" (UniqueName: \"kubernetes.io/projected/f5956530-c1d2-4a28-9fb6-01eb44512b32-kube-api-access-dttzv\") pod \"node-ca-f4x8q\" (UID: \"f5956530-c1d2-4a28-9fb6-01eb44512b32\") " pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.645762 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.645738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffq5f\" (UniqueName: \"kubernetes.io/projected/5a63b706-c845-4ece-81a0-4968cae1fe75-kube-api-access-ffq5f\") pod \"ovnkube-node-pjvw9\" (UID: \"5a63b706-c845-4ece-81a0-4968cae1fe75\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.645839 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.645815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7tsf\" (UniqueName: \"kubernetes.io/projected/e977c4f3-8eab-4dc7-9d8f-0508e4d95572-kube-api-access-q7tsf\") pod \"tuned-5gpgf\" (UID: \"e977c4f3-8eab-4dc7-9d8f-0508e4d95572\") " pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.736371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f4f09-3fe6-49a6-9562-1549de6dddb2-iptables-alerter-script\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.736371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cni-binary-copy\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-device-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-hosts-file\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-k8s-cni-cncf-io\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-bin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736490    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-hosts-file\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-k8s-cni-cncf-io\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.736532 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.736526    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-device-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-daemon-config\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736581    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.736629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:03.236585746 +0000 UTC m=+2.115100991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736641    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-bin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjl67\" (UniqueName: \"kubernetes.io/projected/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-kube-api-access-rjl67\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-kubelet-config\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.736714    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-dbus\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.736772    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:03.236755589 +0000 UTC m=+2.115270827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-dbus\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0e212fef-9eb1-4b39-95dd-2f500579ff73-kubelet-config\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-sys-fs\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736853    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-sys-fs\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.736994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-multus-certs\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-tmp-dir\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736895    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-multus-certs\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw2vh\" (UniqueName: \"kubernetes.io/projected/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-kube-api-access-hw2vh\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cnibin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-kubelet\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.736995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f4f09-3fe6-49a6-9562-1549de6dddb2-host-slash\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/047f4f09-3fe6-49a6-9562-1549de6dddb2-host-slash\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/047f4f09-3fe6-49a6-9562-1549de6dddb2-iptables-alerter-script\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cni-binary-copy\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-cnibin\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-kubelet\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-tmp-dir\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:02.737720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-socket-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-etc-selinux\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-multus\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-daemon-config\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sr4q\" (UniqueName: \"kubernetes.io/projected/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kube-api-access-6sr4q\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-var-lib-cni-multus\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-socket-dir-parent\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-netns\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-hostroot\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-host-run-netns\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-socket-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-conf-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-socket-dir-parent\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srw9m\" (UniqueName: \"kubernetes.io/projected/bba79b0b-9db3-4ab5-90db-9881c2898a54-kube-api-access-srw9m\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737452    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-multus-conf-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737459    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-hostroot\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-system-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz47m\" (UniqueName: \"kubernetes.io/projected/047f4f09-3fe6-49a6-9562-1549de6dddb2-kube-api-access-qz47m\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.738265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-system-cni-dir\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-etc-kubernetes\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-registration-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.738883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-etc-kubernetes\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.738883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.737615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-registration-dir\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.744856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.744835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjl67\" (UniqueName: \"kubernetes.io/projected/8af74d70-08e1-4c49-9d14-1d2cc08bd6db-kube-api-access-rjl67\") pod \"multus-4bh9x\" (UID: \"8af74d70-08e1-4c49-9d14-1d2cc08bd6db\") " pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.748088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.748073    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz47m\" (UniqueName: \"kubernetes.io/projected/047f4f09-3fe6-49a6-9562-1549de6dddb2-kube-api-access-qz47m\") pod \"iptables-alerter-tb57t\" (UID: \"047f4f09-3fe6-49a6-9562-1549de6dddb2\") " pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.750017 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.749996    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:02.750144 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.750020    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:02.750144 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.750034    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:02.750144 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:02.750120    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:03.25010385 +0000 UTC m=+2.128619092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:02.751258 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.751241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw2vh\" (UniqueName: \"kubernetes.io/projected/af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac-kube-api-access-hw2vh\") pod \"node-resolver-hzxrn\" (UID: \"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac\") " pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.751482 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.751462    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srw9m\" (UniqueName: \"kubernetes.io/projected/bba79b0b-9db3-4ab5-90db-9881c2898a54-kube-api-access-srw9m\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:02.751871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.751851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sr4q\" (UniqueName: \"kubernetes.io/projected/df83ddf2-0d9d-4b60-8612-8ef6cf33b99b-kube-api-access-6sr4q\") pod \"aws-ebs-csi-driver-node-4hk7m\" (UID: \"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.765482 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.765458    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1921d7596feedc2338fdc3de110f547.slice/crio-8838d834575bbf29c382a5c3bcf3abde1ef69906cb590d8bd9691d75cd71a0a4 WatchSource:0}: Error finding container 8838d834575bbf29c382a5c3bcf3abde1ef69906cb590d8bd9691d75cd71a0a4: Status 404 returned error can't find the container with id 8838d834575bbf29c382a5c3bcf3abde1ef69906cb590d8bd9691d75cd71a0a4
Sep 17 23:06:02.765946 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.765933    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b8577d582e483569f5b31aa0c4b233.slice/crio-07688856bf749d19848dbaa63445682d5e28c6a5757571f8b629f64c677b5f88 WatchSource:0}: Error finding container 07688856bf749d19848dbaa63445682d5e28c6a5757571f8b629f64c677b5f88: Status 404 returned error can't find the container with id 07688856bf749d19848dbaa63445682d5e28c6a5757571f8b629f64c677b5f88
Sep 17 23:06:02.770608 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.770595    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:06:02.842758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.842707    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gpgf"
Sep 17 23:06:02.852453 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.852434    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode977c4f3_8eab_4dc7_9d8f_0508e4d95572.slice/crio-2bcde6887489cd4ffb687a69127dad5a9a0f1c12d4e8ef5e81887ecdcd0dcb25 WatchSource:0}: Error finding container 2bcde6887489cd4ffb687a69127dad5a9a0f1c12d4e8ef5e81887ecdcd0dcb25: Status 404 returned error can't find the container with id 2bcde6887489cd4ffb687a69127dad5a9a0f1c12d4e8ef5e81887ecdcd0dcb25
Sep 17 23:06:02.859826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.859807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:02.867035 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.867017    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36f5855_8bb2_4208_87b9_ab66292212a3.slice/crio-a518e9a7cd2fb5f1c274508e34bc391fbc9e2bc19e93647d75632756999b3bba WatchSource:0}: Error finding container a518e9a7cd2fb5f1c274508e34bc391fbc9e2bc19e93647d75632756999b3bba: Status 404 returned error can't find the container with id a518e9a7cd2fb5f1c274508e34bc391fbc9e2bc19e93647d75632756999b3bba
Sep 17 23:06:02.880676 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.880660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:02.890338 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.890317    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a63b706_c845_4ece_81a0_4968cae1fe75.slice/crio-c7343dfdee390ee4dda42f48a1a14ae2b86c7070c654f9ad04bf4c36f90c2201 WatchSource:0}: Error finding container c7343dfdee390ee4dda42f48a1a14ae2b86c7070c654f9ad04bf4c36f90c2201: Status 404 returned error can't find the container with id c7343dfdee390ee4dda42f48a1a14ae2b86c7070c654f9ad04bf4c36f90c2201
Sep 17 23:06:02.890994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.890967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f4x8q"
Sep 17 23:06:02.898537 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.898517    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5956530_c1d2_4a28_9fb6_01eb44512b32.slice/crio-79bccfe0d5d393d6c9b58ab6741e0da528a938525f87aeddf319eb396c9d9e6f WatchSource:0}: Error finding container 79bccfe0d5d393d6c9b58ab6741e0da528a938525f87aeddf319eb396c9d9e6f: Status 404 returned error can't find the container with id 79bccfe0d5d393d6c9b58ab6741e0da528a938525f87aeddf319eb396c9d9e6f
Sep 17 23:06:02.907386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.907368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s7kvw"
Sep 17 23:06:02.915665 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.915645    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f43e326_7d27_4547_931f_3b25540b849e.slice/crio-310443e24bd014be40544cd0cf7fbd34116ccdf090cbae7afe9fec48810625c5 WatchSource:0}: Error finding container 310443e24bd014be40544cd0cf7fbd34116ccdf090cbae7afe9fec48810625c5: Status 404 returned error can't find the container with id 310443e24bd014be40544cd0cf7fbd34116ccdf090cbae7afe9fec48810625c5
Sep 17 23:06:02.928972 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.928956    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bh9x"
Sep 17 23:06:02.936318 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.936300    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af74d70_08e1_4c49_9d14_1d2cc08bd6db.slice/crio-7dc8e890945c8732b9eb11e373ec36670e3e57a44bc20d97c00e6bf041c17a5e WatchSource:0}: Error finding container 7dc8e890945c8732b9eb11e373ec36670e3e57a44bc20d97c00e6bf041c17a5e: Status 404 returned error can't find the container with id 7dc8e890945c8732b9eb11e373ec36670e3e57a44bc20d97c00e6bf041c17a5e
Sep 17 23:06:02.953350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.953335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tb57t"
Sep 17 23:06:02.960777 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.960754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047f4f09_3fe6_49a6_9562_1549de6dddb2.slice/crio-f22f3d19f3706e9ea67ae222e22543ae3c2ab0a01e3ed2710b47d736ee885fef WatchSource:0}: Error finding container f22f3d19f3706e9ea67ae222e22543ae3c2ab0a01e3ed2710b47d736ee885fef: Status 404 returned error can't find the container with id f22f3d19f3706e9ea67ae222e22543ae3c2ab0a01e3ed2710b47d736ee885fef
Sep 17 23:06:02.975846 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.975828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m"
Sep 17 23:06:02.980882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:02.980864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzxrn"
Sep 17 23:06:02.984334 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.984315    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf83ddf2_0d9d_4b60_8612_8ef6cf33b99b.slice/crio-8d77d2505d69bd095945c97c56139ffb10cde12c8a144a77c7eb95ff4689ea41 WatchSource:0}: Error finding container 8d77d2505d69bd095945c97c56139ffb10cde12c8a144a77c7eb95ff4689ea41: Status 404 returned error can't find the container with id 8d77d2505d69bd095945c97c56139ffb10cde12c8a144a77c7eb95ff4689ea41
Sep 17 23:06:02.988739 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:02.988720    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3cdbb3_17f7_4ce9_8bc0_cd4954ca56ac.slice/crio-27259b81d2fdb4618753a31e9cb0fbc16d8e742e4de4f8c0320311147dff7f8c WatchSource:0}: Error finding container 27259b81d2fdb4618753a31e9cb0fbc16d8e742e4de4f8c0320311147dff7f8c: Status 404 returned error can't find the container with id 27259b81d2fdb4618753a31e9cb0fbc16d8e742e4de4f8c0320311147dff7f8c
Sep 17 23:06:03.035858 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.035828    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:03.241040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.240961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:03.241040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.241003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:03.241279 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.241168    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:03.241279 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.241174    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:03.241279 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.241239    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:04.24121969 +0000 UTC m=+3.119734916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:03.241279 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.241258    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:04.241248578 +0000 UTC m=+3.119763808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:03.342075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.342027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:03.342273 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.342254    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:03.342361 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.342284    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:03.342361 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.342297    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:03.342469 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:03.342373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:04.342348499 +0000 UTC m=+3.220863731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:03.459354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.459316    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:03.575115 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.574531    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 23:01:02 +0000 UTC" deadline="2028-05-01 22:26:47.672954116 +0000 UTC"
Sep 17 23:06:03.575115 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.574561    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14207h20m44.098398366s"
Sep 17 23:06:03.710510 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.710400    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:03.712137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.712018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"c7343dfdee390ee4dda42f48a1a14ae2b86c7070c654f9ad04bf4c36f90c2201"}
Sep 17 23:06:03.722292 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.722225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gpgf" event={"ID":"e977c4f3-8eab-4dc7-9d8f-0508e4d95572","Type":"ContainerStarted","Data":"2bcde6887489cd4ffb687a69127dad5a9a0f1c12d4e8ef5e81887ecdcd0dcb25"}
Sep 17 23:06:03.741687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.741653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal" event={"ID":"f1921d7596feedc2338fdc3de110f547","Type":"ContainerStarted","Data":"8838d834575bbf29c382a5c3bcf3abde1ef69906cb590d8bd9691d75cd71a0a4"}
Sep 17 23:06:03.763554 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.763506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal" event={"ID":"08b8577d582e483569f5b31aa0c4b233","Type":"ContainerStarted","Data":"07688856bf749d19848dbaa63445682d5e28c6a5757571f8b629f64c677b5f88"}
Sep 17 23:06:03.786780 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.786701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bh9x" event={"ID":"8af74d70-08e1-4c49-9d14-1d2cc08bd6db","Type":"ContainerStarted","Data":"7dc8e890945c8732b9eb11e373ec36670e3e57a44bc20d97c00e6bf041c17a5e"}
Sep 17 23:06:03.799692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.799610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f4x8q" event={"ID":"f5956530-c1d2-4a28-9fb6-01eb44512b32","Type":"ContainerStarted","Data":"79bccfe0d5d393d6c9b58ab6741e0da528a938525f87aeddf319eb396c9d9e6f"}
Sep 17 23:06:03.819969 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.819929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vq4xx" event={"ID":"a36f5855-8bb2-4208-87b9-ab66292212a3","Type":"ContainerStarted","Data":"a518e9a7cd2fb5f1c274508e34bc391fbc9e2bc19e93647d75632756999b3bba"}
Sep 17 23:06:03.834933 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.834861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzxrn" event={"ID":"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac","Type":"ContainerStarted","Data":"27259b81d2fdb4618753a31e9cb0fbc16d8e742e4de4f8c0320311147dff7f8c"}
Sep 17 23:06:03.842265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.842234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m" event={"ID":"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b","Type":"ContainerStarted","Data":"8d77d2505d69bd095945c97c56139ffb10cde12c8a144a77c7eb95ff4689ea41"}
Sep 17 23:06:03.848736 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.848672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tb57t" event={"ID":"047f4f09-3fe6-49a6-9562-1549de6dddb2","Type":"ContainerStarted","Data":"f22f3d19f3706e9ea67ae222e22543ae3c2ab0a01e3ed2710b47d736ee885fef"}
Sep 17 23:06:03.867711 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:03.867657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerStarted","Data":"310443e24bd014be40544cd0cf7fbd34116ccdf090cbae7afe9fec48810625c5"}
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.249990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.250041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.250170    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.250214    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.250256    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:06.250233483 +0000 UTC m=+5.128748711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:04.250328 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.250277    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:06.250266269 +0000 UTC m=+5.128781500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:04.351307 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.351237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:04.351713 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.351692    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:04.351812 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.351725    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:04.351812 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.351756    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:04.351917 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.351822    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:06.351803939 +0000 UTC m=+5.230319179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:04.575716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.575606    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 23:01:02 +0000 UTC" deadline="2028-03-18 07:03:23.747543079 +0000 UTC"
Sep 17 23:06:04.575716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.575671    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13135h57m19.171876527s"
Sep 17 23:06:04.655386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.655354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:04.655547 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.655486    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:04.655905 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.655884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:04.656022 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.656001    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:04.656110 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:04.656085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:04.656183 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:04.656158    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:05.422156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:05.422125    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 23:06:06.269540 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.269498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:06.269994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.269549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:06.269994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.269706    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:06.269994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.269719    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:06.269994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.269785    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:10.269764949 +0000 UTC m=+9.148280180 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:06.269994 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.269805    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:10.269795384 +0000 UTC m=+9.148310613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:06.370284 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.370245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:06.370483 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.370466    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:06.370547 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.370493    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:06.370547 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.370506    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:06.370652 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.370562    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:10.370544267 +0000 UTC m=+9.249059504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:06.654855 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.654606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:06.655017 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.654978    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:06.655216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.654645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:06.655216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.655112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:06.655216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:06.654611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:06.655216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:06.655187    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:08.654204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:08.654353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:08.654471    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:08.654518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:08.654612    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:08.654651 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:08.654348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:10.305077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.305025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:10.305529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.305099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:10.305529 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.305284    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:10.305529 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.305346    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:18.305325884 +0000 UTC m=+17.183841113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:10.305721 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.305690    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:10.305792 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.305752    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:18.305734548 +0000 UTC m=+17.184249788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:10.406067 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.405962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:10.406196 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.406140    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:10.406196 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.406158    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:10.406196 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.406171    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:10.406334 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.406225    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:18.406208452 +0000 UTC m=+17.284723683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.654657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.654677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.654843    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.654908    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:10.654958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:10.655136 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:10.655036    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:12.654120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:12.654092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:12.654499 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:12.654092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:12.654499 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:12.654092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:12.654499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:12.654295    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:12.654499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:12.654331    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:12.654499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:12.654186    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:14.654585 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:14.654509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:14.654585 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:14.654540    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:14.655116 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:14.654510    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:14.655116 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:14.654617    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:14.655116 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:14.654709    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:14.655116 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:14.654785    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:16.655012 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:16.654947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:16.655012 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:16.654972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:16.655012 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:16.654972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:16.655586 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:16.655113    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:16.655586 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:16.655233    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:16.655586 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:16.655332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:18.361324 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.361245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:18.361739 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.361334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:18.361739 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.361409    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:18.361739 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.361413    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:18.361739 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.361466    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.361448073 +0000 UTC m=+33.239963299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:18.361739 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.361485    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.361475873 +0000 UTC m=+33.239991097 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:18.462024 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.461987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:18.462228 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.462139    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:18.462228 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.462166    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:18.462228 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.462179    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:18.462385 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.462244    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:34.462226322 +0000 UTC m=+33.340741565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:18.654366 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.654288    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:18.654366 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.654300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:18.654578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:18.654296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:18.654578 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.654443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:18.654685 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.654575    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:18.654685 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:18.654667    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:20.654432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:20.654400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:20.655062 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:20.654444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:20.655062 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:20.654400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:20.655062 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:20.654525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:20.655062 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:20.654625    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:20.655062 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:20.654701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:22.654383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.654172    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:22.655021 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:22.654482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:22.655021 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.654237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:22.655021 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:22.654633    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:22.655021 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.654276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:22.655021 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:22.654728    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:22.913602 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.913347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bh9x" event={"ID":"8af74d70-08e1-4c49-9d14-1d2cc08bd6db","Type":"ContainerStarted","Data":"08d8522feeafcc4fff40dd9eb2ede01870fa989750cbbb71820f2deaf58ca2d4"}
Sep 17 23:06:22.914839 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.914813    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="3ecf25c43e07b36b158590e4f1fc4ad949866aa2c29caaa13b535af084d05a7b" exitCode=0
Sep 17 23:06:22.914952 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.914852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"3ecf25c43e07b36b158590e4f1fc4ad949866aa2c29caaa13b535af084d05a7b"}
Sep 17 23:06:22.918143 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"98beca5a261381de5d4f9cb920714a6830c2f979aaa7ce3e2af8012ed2007bec"}
Sep 17 23:06:22.918238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"c43d502b704078d403b143ce951ec3184945f75859d82290929d3590d766846e"}
Sep 17 23:06:22.918238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"c384b33a0fe057513e52909860a000f01cef157da0d0b0ad599c4a403c913f5d"}
Sep 17 23:06:22.918402 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"4d9154efe09207a65c8c688208a455b17ec8d9504ab71e92ade092123183200b"}
Sep 17 23:06:22.918402 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"66784e1486c738e2fc0e3d9157b552b5e4b35a56764841c19ee450661c405ea5"}
Sep 17 23:06:22.918402 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.918364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"cb9f13ee705a40461f20c1a492ad7496caa3eb8b78cda7a40b962c6f00398fe6"}
Sep 17 23:06:22.919593 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.919576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gpgf" event={"ID":"e977c4f3-8eab-4dc7-9d8f-0508e4d95572","Type":"ContainerStarted","Data":"20daaf0948f8e9d04adae1d32dd5a14bd6270ca9b557b0539aa254eac5c6da58"}
Sep 17 23:06:22.921031 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.921012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal" event={"ID":"f1921d7596feedc2338fdc3de110f547","Type":"ContainerStarted","Data":"0e137260dee86f0a37ed99b2cf16e9acc31f29ece8ab5bfadb1c63224b1441d4"}
Sep 17 23:06:22.938125 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.938085    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4bh9x" podStartSLOduration=3.181316108 podStartE2EDuration="21.938072131s" totalImagesPullingTime="18.756756023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:22.937652644 +0000 UTC m=+21.816167891" watchObservedRunningTime="2026-09-17 23:06:22.938072131 +0000 UTC m=+21.816587377"
Sep 17 23:06:22.954327 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.954288    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5gpgf" podStartSLOduration=3.196207945 podStartE2EDuration="21.954274377s" totalImagesPullingTime="18.758066432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:22.953709285 +0000 UTC m=+21.832224528" watchObservedRunningTime="2026-09-17 23:06:22.954274377 +0000 UTC m=+21.832789622"
Sep 17 23:06:22.968162 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:22.968127    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-33.ec2.internal" podStartSLOduration=20.968114796000002 podStartE2EDuration="20.968114796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:22.967786344 +0000 UTC m=+21.846301591" watchObservedRunningTime="2026-09-17 23:06:22.968114796 +0000 UTC m=+21.846630042"
Sep 17 23:06:23.925854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.925780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vq4xx" event={"ID":"a36f5855-8bb2-4208-87b9-ab66292212a3","Type":"ContainerStarted","Data":"a74fe40bc6bc0a5243537119c58198d7bc0ae6a3dc50727f25f45e6b0ef1f7ec"}
Sep 17 23:06:23.927692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.927662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzxrn" event={"ID":"af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac","Type":"ContainerStarted","Data":"10fc0b5802ff4b80c55aacb073618a081b64513b62149898725e3b5bd1855b19"}
Sep 17 23:06:23.929833 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.929808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m" event={"ID":"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b","Type":"ContainerStarted","Data":"e1e81501a7685f841a4fefe6d4843e8242c016cb61bc3b22df01c122f30907f0"}
Sep 17 23:06:23.931735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.931708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tb57t" event={"ID":"047f4f09-3fe6-49a6-9562-1549de6dddb2","Type":"ContainerStarted","Data":"5116066e21b98e9b87c260fe47f9b385cd3fdca2f81a65abfe156a3d82c6c52f"}
Sep 17 23:06:23.933681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.933656    2581 generic.go:356] "Generic (PLEG): container finished" podID="08b8577d582e483569f5b31aa0c4b233" containerID="ebfb31359e8ff3ce34a9f6077be8b098c489764c84827917922d6543c0e6d348" exitCode=0
Sep 17 23:06:23.933774 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.933709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal" event={"ID":"08b8577d582e483569f5b31aa0c4b233","Type":"ContainerDied","Data":"ebfb31359e8ff3ce34a9f6077be8b098c489764c84827917922d6543c0e6d348"}
Sep 17 23:06:23.935720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.935692    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f4x8q" event={"ID":"f5956530-c1d2-4a28-9fb6-01eb44512b32","Type":"ContainerStarted","Data":"8278920c0cf30163eaa26cf12459d4828c9fde0300b51c8a753101656c31e04f"}
Sep 17 23:06:23.961502 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.961454    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vq4xx" podStartSLOduration=4.218456157 podStartE2EDuration="22.961439602s" totalImagesPullingTime="18.742983445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:23.944033405 +0000 UTC m=+22.822548653" watchObservedRunningTime="2026-09-17 23:06:23.961439602 +0000 UTC m=+22.839954848"
Sep 17 23:06:23.975842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.975795    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f4x8q" podStartSLOduration=4.190403914 podStartE2EDuration="22.975775745s" totalImagesPullingTime="18.785371831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:23.975184573 +0000 UTC m=+22.853699819" watchObservedRunningTime="2026-09-17 23:06:23.975775745 +0000 UTC m=+22.854290995"
Sep 17 23:06:23.990990 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:23.990942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tb57t" podStartSLOduration=3.341228779 podStartE2EDuration="21.990926219s" totalImagesPullingTime="18.64969744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:23.99048496 +0000 UTC m=+22.869000218" watchObservedRunningTime="2026-09-17 23:06:23.990926219 +0000 UTC m=+22.869441466"
Sep 17 23:06:24.005733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.005680    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hzxrn" podStartSLOduration=3.304630279 podStartE2EDuration="22.005660687s" totalImagesPullingTime="18.701030408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:24.005624104 +0000 UTC m=+22.884139351" watchObservedRunningTime="2026-09-17 23:06:24.005660687 +0000 UTC m=+22.884175934"
Sep 17 23:06:24.124522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.124497    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 23:06:24.594633 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.594510    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T23:06:24.124514175Z","UUID":"e4ef3727-4cf1-4a74-9a62-014f20e57be9","Handler":null,"Name":"","Endpoint":""}
Sep 17 23:06:24.596496 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.596474    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 23:06:24.596617 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.596511    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 23:06:24.655269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.655170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:24.655269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.655218    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:24.655531 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:24.655327    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:24.655531 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:24.655386    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:24.655531 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.655444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:24.655531 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:24.655514    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:24.940281 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.940169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m" event={"ID":"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b","Type":"ContainerStarted","Data":"d4cfa92eedc4f9b1cb75c666658e5c6060e29802d5caee5c2b2ad2bf83d54b48"}
Sep 17 23:06:24.942346 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.942318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal" event={"ID":"08b8577d582e483569f5b31aa0c4b233","Type":"ContainerStarted","Data":"edc19d1cff2dea7acc9e9eab84394c3b16dadc9153f8abc7c8cfeaedc9523bec"}
Sep 17 23:06:24.961113 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:24.958870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-33.ec2.internal" podStartSLOduration=22.958852415 podStartE2EDuration="22.958852415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:24.95855411 +0000 UTC m=+23.837069357" watchObservedRunningTime="2026-09-17 23:06:24.958852415 +0000 UTC m=+23.837367665"
Sep 17 23:06:25.947679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:25.947637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m" event={"ID":"df83ddf2-0d9d-4b60-8612-8ef6cf33b99b","Type":"ContainerStarted","Data":"fbc16867f6f7f6dde455920780bcbead19f7abb038affcdf90c1566aaf033d3c"}
Sep 17 23:06:25.952111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:25.952076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"164547146c0c9c9898ced4efe59cfe94f80ff2c480b1f24e22f0fb0d6414844b"}
Sep 17 23:06:25.966227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:25.966186    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4hk7m" podStartSLOduration=3.469481052 podStartE2EDuration="23.966169733s" totalImagesPullingTime="20.496688681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:25.965981739 +0000 UTC m=+24.844496985" watchObservedRunningTime="2026-09-17 23:06:25.966169733 +0000 UTC m=+24.844684978"
Sep 17 23:06:26.300730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.300654    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:26.301260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.301239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:26.654480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.654391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:26.654644 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:26.654528    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:26.654692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.654639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:26.654873 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:26.654813    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:26.654873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.654838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:26.655031 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:26.654947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:26.954140 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.954054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:26.954533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:26.954509    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vq4xx"
Sep 17 23:06:27.957957 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:27.957918    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="c747285b2d3e97563869457b9ebedcd721aac669301b0c283bc8ed2a100fc425" exitCode=0
Sep 17 23:06:27.958424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:27.958007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"c747285b2d3e97563869457b9ebedcd721aac669301b0c283bc8ed2a100fc425"}
Sep 17 23:06:27.963680 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:27.963654    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" event={"ID":"5a63b706-c845-4ece-81a0-4968cae1fe75","Type":"ContainerStarted","Data":"3eb87fd0e62b874a3a3cd99b4987d6c7e95c1bc6677129cd47eb65fa72efe655"}
Sep 17 23:06:28.005470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.005400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9" podStartSLOduration=7.585575278 podStartE2EDuration="27.005383815s" totalImagesPullingTime="19.419808537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:28.00413078 +0000 UTC m=+26.882646025" watchObservedRunningTime="2026-09-17 23:06:28.005383815 +0000 UTC m=+26.883899086"
Sep 17 23:06:28.654993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.654969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:28.655132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.654970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:28.655132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.654969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:28.655225 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:28.655150    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:28.655272 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:28.655244    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:28.655375 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:28.655352    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:28.968092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.967985    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="c20ca522e8a028f48282c7affc920103c7950166a17fa0b685a3ba0058a0913a" exitCode=0
Sep 17 23:06:28.968092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.968083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"c20ca522e8a028f48282c7affc920103c7950166a17fa0b685a3ba0058a0913a"}
Sep 17 23:06:28.968667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.968644    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:28.968749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.968705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:28.968892 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.968752    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:28.983655 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.983634    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:28.983764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:28.983726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:06:29.055224 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.055184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmwfh"]
Sep 17 23:06:29.055405 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.055294    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:29.055467 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:29.055403    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:29.061461 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.061434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mm4gc"]
Sep 17 23:06:29.061592 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.061557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:29.061658 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:29.061639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:29.072076 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.072034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9bc9s"]
Sep 17 23:06:29.072172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.072135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:29.072219 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:29.072201    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:29.972545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.972455    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="6be9658cb2db07b43f5c4489865dab1cb19e28ca51b57995aaf93b6f27f2332e" exitCode=0
Sep 17 23:06:29.973139 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:29.972543    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"6be9658cb2db07b43f5c4489865dab1cb19e28ca51b57995aaf93b6f27f2332e"}
Sep 17 23:06:30.655168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:30.655135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:30.655168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:30.655162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:30.655168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:30.655162    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:30.655458 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:30.655261    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:30.655458 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:30.655335    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:30.655458 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:30.655420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:32.654812 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:32.654587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:32.655453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:32.654602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:32.655453 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:32.654908    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:32.655453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:32.654660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:32.655453 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:32.654998    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:32.655453 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:32.655078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:34.381089 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.381058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:34.381089 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.381089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:34.381513 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.381200    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:34.381513 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.381213    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:34.381513 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.381252    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs podName:bba79b0b-9db3-4ab5-90db-9881c2898a54 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:06.381234844 +0000 UTC m=+65.259750070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs") pod "network-metrics-daemon-mm4gc" (UID: "bba79b0b-9db3-4ab5-90db-9881c2898a54") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 23:06:34.381513 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.381275    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret podName:0e212fef-9eb1-4b39-95dd-2f500579ff73 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:06.38125787 +0000 UTC m=+65.259773097 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret") pod "global-pull-secret-syncer-9bc9s" (UID: "0e212fef-9eb1-4b39-95dd-2f500579ff73") : object "kube-system"/"original-pull-secret" not registered
Sep 17 23:06:34.481381 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.481354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:34.481560 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.481541    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 23:06:34.481599 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.481572    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 23:06:34.481599 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.481587    2581 projected.go:196] Error preparing data for projected volume kube-api-access-tthjd for pod openshift-network-diagnostics/network-check-target-bmwfh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:34.481665 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.481651    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd podName:c5ea2ee2-c30e-4241-963b-a3979760d459 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:06.481628339 +0000 UTC m=+65.360143564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tthjd" (UniqueName: "kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd") pod "network-check-target-bmwfh" (UID: "c5ea2ee2-c30e-4241-963b-a3979760d459") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 23:06:34.654995 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.654915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:34.655193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.654939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:34.655193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.655035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:34.655193 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.655036    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmwfh" podUID="c5ea2ee2-c30e-4241-963b-a3979760d459"
Sep 17 23:06:34.655193 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.655122    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mm4gc" podUID="bba79b0b-9db3-4ab5-90db-9881c2898a54"
Sep 17 23:06:34.655408 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:34.655222    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9bc9s" podUID="0e212fef-9eb1-4b39-95dd-2f500579ff73"
Sep 17 23:06:34.886912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.886889    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-33.ec2.internal" event="NodeReady"
Sep 17 23:06:34.887082 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.887020    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 23:06:34.922989 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.922922    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:06:34.935737 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.935711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:34.935877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.935826    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qf8fb"]
Sep 17 23:06:34.938096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.938074    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 23:06:34.938250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.938113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 23:06:34.938250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.938133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 23:06:34.938444 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.938430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwfw7\""
Sep 17 23:06:34.943787 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.943765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 23:06:34.947877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.947855    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:34.948850 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.948823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:06:34.949570 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.949541    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fwvkr"]
Sep 17 23:06:34.950359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.950338    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 23:06:34.950566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.950535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 23:06:34.951218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.951061    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-62qw9\""
Sep 17 23:06:34.961704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.961685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qf8fb"]
Sep 17 23:06:34.961783 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.961714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwvkr"]
Sep 17 23:06:34.961783 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.961778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:34.964276 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.964259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 23:06:34.964408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.964395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljrmd\""
Sep 17 23:06:34.964449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.964436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 23:06:34.966261 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.966247    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 23:06:34.986965 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.986942    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="89d530521bdd5bb4855d7e78ecf79dee05e2f16f03aaae6a485847a1ade56937" exitCode=0
Sep 17 23:06:34.987070 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:34.986987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"89d530521bdd5bb4855d7e78ecf79dee05e2f16f03aaae6a485847a1ade56937"}
Sep 17 23:06:35.085323 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.085548 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2xpb\" (UniqueName: \"kubernetes.io/projected/496c7bf5-150e-4375-a256-46ad515115e1-kube-api-access-l2xpb\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.085548 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085549    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvqf\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83144408-58fc-403f-84b6-350fc3b586fc-tmp-dir\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.085639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83144408-58fc-403f-84b6-350fc3b586fc-config-volume\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.085807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.085807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgppl\" (UniqueName: \"kubernetes.io/projected/83144408-58fc-403f-84b6-350fc3b586fc-kube-api-access-hgppl\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.085807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/496c7bf5-150e-4375-a256-46ad515115e1-cert\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.085807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.085789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.094055 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.094026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:35.178358 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.178300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:35.186225 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83144408-58fc-403f-84b6-350fc3b586fc-tmp-dir\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.186335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83144408-58fc-403f-84b6-350fc3b586fc-config-volume\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.186335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgppl\" (UniqueName: \"kubernetes.io/projected/83144408-58fc-403f-84b6-350fc3b586fc-kube-api-access-hgppl\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.186486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/496c7bf5-150e-4375-a256-46ad515115e1-cert\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.186486 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.186406    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:35.186486 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.186426    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:35.186486 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.186483    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:06:35.686463795 +0000 UTC m=+34.564979025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83144408-58fc-403f-84b6-350fc3b586fc-tmp-dir\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186527    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2xpb\" (UniqueName: \"kubernetes.io/projected/496c7bf5-150e-4375-a256-46ad515115e1-kube-api-access-l2xpb\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.186790 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.186771    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:35.187180 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.186843    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:35.686822411 +0000 UTC m=+34.565337637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:35.187180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.187180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/83144408-58fc-403f-84b6-350fc3b586fc-config-volume\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.187180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvqf\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.187180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.186970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.187431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.187376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.187956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.187937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.190517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.190495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.190517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.190511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.190629 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.190528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/496c7bf5-150e-4375-a256-46ad515115e1-cert\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.195256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.195232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.195844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.195829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2xpb\" (UniqueName: \"kubernetes.io/projected/496c7bf5-150e-4375-a256-46ad515115e1-kube-api-access-l2xpb\") pod \"ingress-canary-fwvkr\" (UID: \"496c7bf5-150e-4375-a256-46ad515115e1\") " pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.195896 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.195867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgppl\" (UniqueName: \"kubernetes.io/projected/83144408-58fc-403f-84b6-350fc3b586fc-kube-api-access-hgppl\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.196094 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.196079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvqf\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.270140 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.270111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fwvkr"
Sep 17 23:06:35.584525 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.584307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fwvkr"]
Sep 17 23:06:35.588121 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:35.588095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod496c7bf5_150e_4375_a256_46ad515115e1.slice/crio-b892cc04e2dfd9f3fc958ea11e194bf4a512cac1e6a5c666eebdce8b6502be01 WatchSource:0}: Error finding container b892cc04e2dfd9f3fc958ea11e194bf4a512cac1e6a5c666eebdce8b6502be01: Status 404 returned error can't find the container with id b892cc04e2dfd9f3fc958ea11e194bf4a512cac1e6a5c666eebdce8b6502be01
Sep 17 23:06:35.689867 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.689834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:35.690039 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.689888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:35.690039 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.689979    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:35.690039 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.689995    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:35.690039 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.690002    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:35.690206 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.690072    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:36.690035163 +0000 UTC m=+35.568550387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:35.690206 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:35.690087    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:06:36.690080785 +0000 UTC m=+35.568596009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:35.993967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.993887    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f43e326-7d27-4547-931f-3b25540b849e" containerID="db57677f459665d21480fd3626658f94514645500bd5263a094621da6d6cb9a8" exitCode=0
Sep 17 23:06:35.993967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.993932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerDied","Data":"db57677f459665d21480fd3626658f94514645500bd5263a094621da6d6cb9a8"}
Sep 17 23:06:35.995425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:35.995368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwvkr" event={"ID":"496c7bf5-150e-4375-a256-46ad515115e1","Type":"ContainerStarted","Data":"b892cc04e2dfd9f3fc958ea11e194bf4a512cac1e6a5c666eebdce8b6502be01"}
Sep 17 23:06:36.654692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.654661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:06:36.654692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.654681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:06:36.655419 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.654671    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:06:36.657162 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.657140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 23:06:36.658077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.658038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 23:06:36.658200 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.658136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 23:06:36.658261 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.658038    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8cnd\""
Sep 17 23:06:36.658337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.658315    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 23:06:36.658458 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.658378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkqjx\""
Sep 17 23:06:36.697791 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.697764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:36.697912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:36.697847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:36.697975 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:36.697913    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:36.697975 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:36.697928    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:36.697975 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:36.697939    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:36.698144 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:36.697979    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:06:38.697962486 +0000 UTC m=+37.576477711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:36.698144 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:36.697999    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:38.697990372 +0000 UTC m=+37.576505600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:37.002145 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.002059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" event={"ID":"2f43e326-7d27-4547-931f-3b25540b849e","Type":"ContainerStarted","Data":"b4d119a03aef977a7d2c3208918de691e03a3cbd77d61e58c9b6a9e9bd87e484"}
Sep 17 23:06:37.023739 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.023684    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s7kvw" podStartSLOduration=7.463845421 podStartE2EDuration="36.023661194s" totalImagesPullingTime="28.559815773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:37.022480634 +0000 UTC m=+35.900995883" watchObservedRunningTime="2026-09-17 23:06:37.023661194 +0000 UTC m=+35.902176485"
Sep 17 23:06:37.141361 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.141323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:37.197291 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.197255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:37.262623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.262515    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:37.359980 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:37.359948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log" limit=1024
Sep 17 23:06:38.715100 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:38.715040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:38.715132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:38.715214    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:38.715225    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:38.715239    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:38.715279    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:42.715263171 +0000 UTC m=+41.593778398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:38.715744 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:38.715299    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:06:42.715287382 +0000 UTC m=+41.593802605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:39.008476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:39.008388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fwvkr" event={"ID":"496c7bf5-150e-4375-a256-46ad515115e1","Type":"ContainerStarted","Data":"9c8a10d3a17e7df964308f3c80449c0a81ab794582ca6696e97ccd09d4aa2db2"}
Sep 17 23:06:39.026120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:39.026072    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fwvkr" podStartSLOduration=2.611000368 podStartE2EDuration="5.026040967s" totalImagesPullingTime="2.415040599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:39.02539517 +0000 UTC m=+37.903910420" watchObservedRunningTime="2026-09-17 23:06:39.026040967 +0000 UTC m=+37.904556214"
Sep 17 23:06:42.744910 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:42.744870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:42.744935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:42.745032    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:42.745130    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:06:50.74510768 +0000 UTC m=+49.623622923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:42.745039    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:42.745152    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:42.745430 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:42.745200    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:06:50.745184393 +0000 UTC m=+49.623699617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:47.220797 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.220763    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"]
Sep 17 23:06:47.269025 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.268999    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"]
Sep 17 23:06:47.269176 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.269133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"
Sep 17 23:06:47.271881 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.271856    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pxn6t\""
Sep 17 23:06:47.282433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.282415    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-p26gf"]
Sep 17 23:06:47.282539 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.282525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"
Sep 17 23:06:47.285279 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.285262    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gwqtw\""
Sep 17 23:06:47.285829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.285802    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.288900 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.288880    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.300529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.300510    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6454dbbfc8-27mq8"]
Sep 17 23:06:47.300636 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.300621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.303679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.303661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 23:06:47.303817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.303714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-zg6tq\""
Sep 17 23:06:47.304641 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.304623    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.305090 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.305072    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 23:06:47.305176 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.305098    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.309752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.309736    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 23:06:47.323801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"]
Sep 17 23:06:47.323801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323798    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.323955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323851    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"]
Sep 17 23:06:47.323955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-p26gf"]
Sep 17 23:06:47.323955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6454dbbfc8-27mq8"]
Sep 17 23:06:47.323955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.323902    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"]
Sep 17 23:06:47.327222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 23:06:47.327412 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327392    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 23:06:47.327507 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327464    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.327507 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327464    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.327617 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327463    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 23:06:47.327617 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327490    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 23:06:47.327724 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.327616    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rnrqj\""
Sep 17 23:06:47.347511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.347487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.347511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.347490    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"]
Sep 17 23:06:47.349965 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.349946    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.350075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.350004    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.350939 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.350924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 23:06:47.350939 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.350932    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8bmwl\""
Sep 17 23:06:47.351062 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.350956    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 23:06:47.365603 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.365585    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-nf7ww"]
Sep 17 23:06:47.365709 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.365696    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.368192 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.368165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 23:06:47.368295 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.368226    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.368295 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.368235    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.368407 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.368293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-775zh\""
Sep 17 23:06:47.379640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.379624    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"]
Sep 17 23:06:47.379742 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.379729    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.379954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.379929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q276s\" (UniqueName: \"kubernetes.io/projected/9a408a4e-74a9-47b8-ba1d-cb0b13bc1074-kube-api-access-q276s\") pod \"volume-data-source-validator-5c4db8bdf9-26rbc\" (UID: \"9a408a4e-74a9-47b8-ba1d-cb0b13bc1074\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"
Sep 17 23:06:47.380040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.379971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcl59\" (UniqueName: \"kubernetes.io/projected/86a8e584-bf3b-491c-9d3a-4af608a972e2-kube-api-access-qcl59\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.380040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380013    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.380206 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285s7\" (UniqueName: \"kubernetes.io/projected/c837a464-f296-42e8-99be-f63a80056849-kube-api-access-285s7\") pod \"network-check-source-7cbc45fddc-qm7v4\" (UID: \"c837a464-f296-42e8-99be-f63a80056849\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"
Sep 17 23:06:47.380264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380221    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-snapshots\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.380264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.380328 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86a8e584-bf3b-491c-9d3a-4af608a972e2-serving-cert\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.380328 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.380309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-tmp\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.382096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.382075    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.382197 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.382105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 23:06:47.382331 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.382317    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m9t8s\""
Sep 17 23:06:47.382400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.382335    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.382502 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.382484    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 23:06:47.389451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.389429    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 23:06:47.401714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.401690    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"]
Sep 17 23:06:47.401836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.401822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.404255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.404235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 23:06:47.404428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.404411    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tlh6d\""
Sep 17 23:06:47.404642 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.404626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.404704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.404643    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 23:06:47.404892 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.404879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.425891 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425869    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425900    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425926    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-nf7ww"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425963    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"]
Sep 17 23:06:47.425973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.425970    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.428466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.428446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 17 23:06:47.428722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.428708    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fcxvx\""
Sep 17 23:06:47.428782 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.428769    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 17 23:06:47.446035 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.446015    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"]
Sep 17 23:06:47.446138 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.446122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.448587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.448570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-q7hcr\""
Sep 17 23:06:47.448794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.448778    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 23:06:47.449405 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.449390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:47.449480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.449410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 23:06:47.449480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.449469    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 23:06:47.480767 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c431891f-26ac-4ca7-a0d6-7d761de8f49f-serving-cert\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.480767 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-285s7\" (UniqueName: \"kubernetes.io/projected/c837a464-f296-42e8-99be-f63a80056849-kube-api-access-285s7\") pod \"network-check-source-7cbc45fddc-qm7v4\" (UID: \"c837a464-f296-42e8-99be-f63a80056849\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"
Sep 17 23:06:47.480935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.480935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86a8e584-bf3b-491c-9d3a-4af608a972e2-serving-cert\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.480935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.481120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-trusted-ca\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.481120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.480997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q276s\" (UniqueName: \"kubernetes.io/projected/9a408a4e-74a9-47b8-ba1d-cb0b13bc1074-kube-api-access-q276s\") pod \"volume-data-source-validator-5c4db8bdf9-26rbc\" (UID: \"9a408a4e-74a9-47b8-ba1d-cb0b13bc1074\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"
Sep 17 23:06:47.481120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.481120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-default-certificate\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.481120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfcw\" (UniqueName: \"kubernetes.io/projected/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-kube-api-access-9xfcw\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q7bq\" (UniqueName: \"kubernetes.io/projected/fecf9a2c-da73-4901-b5f7-b4b77148f28c-kube-api-access-8q7bq\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-tmp\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-stats-auth\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.481378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9qb\" (UniqueName: \"kubernetes.io/projected/c431891f-26ac-4ca7-a0d6-7d761de8f49f-kube-api-access-cj9qb\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-snapshots\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjm8t\" (UniqueName: \"kubernetes.io/projected/ffa416ac-87d1-4c73-b12e-f8b20f487184-kube-api-access-pjm8t\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcl59\" (UniqueName: \"kubernetes.io/projected/86a8e584-bf3b-491c-9d3a-4af608a972e2-kube-api-access-qcl59\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-tmp\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-config\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.481769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481703    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-service-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481996 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86a8e584-bf3b-491c-9d3a-4af608a972e2-trusted-ca-bundle\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.481996 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.481923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/86a8e584-bf3b-491c-9d3a-4af608a972e2-snapshots\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.484228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.484212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86a8e584-bf3b-491c-9d3a-4af608a972e2-serving-cert\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.495274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.495254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcl59\" (UniqueName: \"kubernetes.io/projected/86a8e584-bf3b-491c-9d3a-4af608a972e2-kube-api-access-qcl59\") pod \"insights-operator-6f9c644dd9-p26gf\" (UID: \"86a8e584-bf3b-491c-9d3a-4af608a972e2\") " pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.495400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.495374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-285s7\" (UniqueName: \"kubernetes.io/projected/c837a464-f296-42e8-99be-f63a80056849-kube-api-access-285s7\") pod \"network-check-source-7cbc45fddc-qm7v4\" (UID: \"c837a464-f296-42e8-99be-f63a80056849\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"
Sep 17 23:06:47.495451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.495407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q276s\" (UniqueName: \"kubernetes.io/projected/9a408a4e-74a9-47b8-ba1d-cb0b13bc1074-kube-api-access-q276s\") pod \"volume-data-source-validator-5c4db8bdf9-26rbc\" (UID: \"9a408a4e-74a9-47b8-ba1d-cb0b13bc1074\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"
Sep 17 23:06:47.578066 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.578026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"
Sep 17 23:06:47.582350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.582428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-trusted-ca\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.582428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33529c70-632d-4090-931b-a861615b2f78-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.582428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf8gc\" (UniqueName: \"kubernetes.io/projected/33529c70-632d-4090-931b-a861615b2f78-kube-api-access-tf8gc\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-default-certificate\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.082487671 +0000 UTC m=+46.961002899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4400476-2bbd-436e-8320-eb0ebfa05c3b-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582588    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:47.582594 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582594    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582634    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.082621383 +0000 UTC m=+46.961136640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfcw\" (UniqueName: \"kubernetes.io/projected/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-kube-api-access-9xfcw\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582694    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.082676434 +0000 UTC m=+46.961191664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582734    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q7bq\" (UniqueName: \"kubernetes.io/projected/fecf9a2c-da73-4901-b5f7-b4b77148f28c-kube-api-access-8q7bq\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17aba131-696c-45c4-80bf-9f9e0367f891-config\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-stats-auth\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.582930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9qb\" (UniqueName: \"kubernetes.io/projected/c431891f-26ac-4ca7-a0d6-7d761de8f49f-kube-api-access-cj9qb\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17aba131-696c-45c4-80bf-9f9e0367f891-serving-cert\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.582913    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.582975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjm8t\" (UniqueName: \"kubernetes.io/projected/ffa416ac-87d1-4c73-b12e-f8b20f487184-kube-api-access-pjm8t\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-config\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.583030    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls podName:fecf9a2c-da73-4901-b5f7-b4b77148f28c nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.083014364 +0000 UTC m=+46.961529588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-55kq8" (UID: "fecf9a2c-da73-4901-b5f7-b4b77148f28c") : secret "samples-operator-tls" not found
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c431891f-26ac-4ca7-a0d6-7d761de8f49f-serving-cert\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w2jj\" (UniqueName: \"kubernetes.io/projected/17aba131-696c-45c4-80bf-9f9e0367f891-kube-api-access-5w2jj\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33529c70-632d-4090-931b-a861615b2f78-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.583446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-trusted-ca\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.583959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.583959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.583667    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c431891f-26ac-4ca7-a0d6-7d761de8f49f-config\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.584998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.584976    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-default-certificate\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.585312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.585296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c431891f-26ac-4ca7-a0d6-7d761de8f49f-serving-cert\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.585379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.585310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-stats-auth\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.592086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.592063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfcw\" (UniqueName: \"kubernetes.io/projected/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-kube-api-access-9xfcw\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:47.592915 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.592892    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9qb\" (UniqueName: \"kubernetes.io/projected/c431891f-26ac-4ca7-a0d6-7d761de8f49f-kube-api-access-cj9qb\") pod \"console-operator-fd4bb46c-nf7ww\" (UID: \"c431891f-26ac-4ca7-a0d6-7d761de8f49f\") " pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.593374 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.593347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjm8t\" (UniqueName: \"kubernetes.io/projected/ffa416ac-87d1-4c73-b12e-f8b20f487184-kube-api-access-pjm8t\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:47.593487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.593421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q7bq\" (UniqueName: \"kubernetes.io/projected/fecf9a2c-da73-4901-b5f7-b4b77148f28c-kube-api-access-8q7bq\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:47.593549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.593526    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"
Sep 17 23:06:47.609727 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.609712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf"
Sep 17 23:06:47.684373 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w2jj\" (UniqueName: \"kubernetes.io/projected/17aba131-696c-45c4-80bf-9f9e0367f891-kube-api-access-5w2jj\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.684477 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33529c70-632d-4090-931b-a861615b2f78-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.684477 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33529c70-632d-4090-931b-a861615b2f78-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.684587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf8gc\" (UniqueName: \"kubernetes.io/projected/33529c70-632d-4090-931b-a861615b2f78-kube-api-access-tf8gc\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.684587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4400476-2bbd-436e-8320-eb0ebfa05c3b-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.684690 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.684690 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17aba131-696c-45c4-80bf-9f9e0367f891-config\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.684798 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.684707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17aba131-696c-45c4-80bf-9f9e0367f891-serving-cert\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.684883 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.684864    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:06:47.684937 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:47.684930    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:06:48.184914893 +0000 UTC m=+47.063430130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:06:47.685205 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.685176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/33529c70-632d-4090-931b-a861615b2f78-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.685626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.685597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e4400476-2bbd-436e-8320-eb0ebfa05c3b-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:47.685690 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.685636    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/17aba131-696c-45c4-80bf-9f9e0367f891-config\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.687265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.687225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/17aba131-696c-45c4-80bf-9f9e0367f891-serving-cert\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.687617 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.687568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/33529c70-632d-4090-931b-a861615b2f78-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.689302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.689274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:47.692936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.692915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w2jj\" (UniqueName: \"kubernetes.io/projected/17aba131-696c-45c4-80bf-9f9e0367f891-kube-api-access-5w2jj\") pod \"service-ca-operator-57cdc4b768-k7z6p\" (UID: \"17aba131-696c-45c4-80bf-9f9e0367f891\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.693236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.693219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf8gc\" (UniqueName: \"kubernetes.io/projected/33529c70-632d-4090-931b-a861615b2f78-kube-api-access-tf8gc\") pod \"kube-storage-version-migrator-operator-55889f7b47-26ccp\" (UID: \"33529c70-632d-4090-931b-a861615b2f78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.710040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.710017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"
Sep 17 23:06:47.754876 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.754799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"
Sep 17 23:06:47.878123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.877989    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4"]
Sep 17 23:06:47.880492 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:47.880465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc837a464_f296_42e8_99be_f63a80056849.slice/crio-bc7f75a01b1b404ffe2c418363539177b88a10ae7244597f7532a8ac293891a7 WatchSource:0}: Error finding container bc7f75a01b1b404ffe2c418363539177b88a10ae7244597f7532a8ac293891a7: Status 404 returned error can't find the container with id bc7f75a01b1b404ffe2c418363539177b88a10ae7244597f7532a8ac293891a7
Sep 17 23:06:47.918371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.918349    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc"]
Sep 17 23:06:47.921780 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:47.921751    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a408a4e_74a9_47b8_ba1d_cb0b13bc1074.slice/crio-a5ebd8612612806715c30279e349c6a7e62f477e187e96601427927a53a352fa WatchSource:0}: Error finding container a5ebd8612612806715c30279e349c6a7e62f477e187e96601427927a53a352fa: Status 404 returned error can't find the container with id a5ebd8612612806715c30279e349c6a7e62f477e187e96601427927a53a352fa
Sep 17 23:06:47.949421 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.949337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-6f9c644dd9-p26gf"]
Sep 17 23:06:47.951492 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:47.951468    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a8e584_bf3b_491c_9d3a_4af608a972e2.slice/crio-df6935026a742901d92e00789d0074c2b485825748c03544bfa0c99c7c80dd36 WatchSource:0}: Error finding container df6935026a742901d92e00789d0074c2b485825748c03544bfa0c99c7c80dd36: Status 404 returned error can't find the container with id df6935026a742901d92e00789d0074c2b485825748c03544bfa0c99c7c80dd36
Sep 17 23:06:47.988263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:47.988236    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-nf7ww"]
Sep 17 23:06:47.990921 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:47.990897    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc431891f_26ac_4ca7_a0d6_7d761de8f49f.slice/crio-a680c86da357d516e7ce4752e4b08a67f5599632dca9cd1779624311dd374f1b WatchSource:0}: Error finding container a680c86da357d516e7ce4752e4b08a67f5599632dca9cd1779624311dd374f1b: Status 404 returned error can't find the container with id a680c86da357d516e7ce4752e4b08a67f5599632dca9cd1779624311dd374f1b
Sep 17 23:06:48.013492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.013469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp"]
Sep 17 23:06:48.015981 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:48.015958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33529c70_632d_4090_931b_a861615b2f78.slice/crio-f9787cc5dc7a42e954998c58121fa14bbb0f8100389c40fc9202443f792c1d1b WatchSource:0}: Error finding container f9787cc5dc7a42e954998c58121fa14bbb0f8100389c40fc9202443f792c1d1b: Status 404 returned error can't find the container with id f9787cc5dc7a42e954998c58121fa14bbb0f8100389c40fc9202443f792c1d1b
Sep 17 23:06:48.033215 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.033184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" event={"ID":"c431891f-26ac-4ca7-a0d6-7d761de8f49f","Type":"ContainerStarted","Data":"a680c86da357d516e7ce4752e4b08a67f5599632dca9cd1779624311dd374f1b"}
Sep 17 23:06:48.034400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.034371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4" event={"ID":"c837a464-f296-42e8-99be-f63a80056849","Type":"ContainerStarted","Data":"bc7f75a01b1b404ffe2c418363539177b88a10ae7244597f7532a8ac293891a7"}
Sep 17 23:06:48.035528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.035502    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc" event={"ID":"9a408a4e-74a9-47b8-ba1d-cb0b13bc1074","Type":"ContainerStarted","Data":"a5ebd8612612806715c30279e349c6a7e62f477e187e96601427927a53a352fa"}
Sep 17 23:06:48.036474 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.036454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp" event={"ID":"33529c70-632d-4090-931b-a861615b2f78","Type":"ContainerStarted","Data":"f9787cc5dc7a42e954998c58121fa14bbb0f8100389c40fc9202443f792c1d1b"}
Sep 17 23:06:48.037342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.037325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf" event={"ID":"86a8e584-bf3b-491c-9d3a-4af608a972e2","Type":"ContainerStarted","Data":"df6935026a742901d92e00789d0074c2b485825748c03544bfa0c99c7c80dd36"}
Sep 17 23:06:48.051623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.051535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p"]
Sep 17 23:06:48.053962 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:48.053941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17aba131_696c_45c4_80bf_9f9e0367f891.slice/crio-000fa0ef4d8a8d89f30b59eee9b9f72bca5177e0ca04b421b807b4f820addef3 WatchSource:0}: Error finding container 000fa0ef4d8a8d89f30b59eee9b9f72bca5177e0ca04b421b807b4f820addef3: Status 404 returned error can't find the container with id 000fa0ef4d8a8d89f30b59eee9b9f72bca5177e0ca04b421b807b4f820addef3
Sep 17 23:06:48.089909 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.089888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:48.090009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.089973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:48.090009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.089994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:48.090105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.090012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:48.090105 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090027    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 23:06:48.090105 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090094    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls podName:fecf9a2c-da73-4901-b5f7-b4b77148f28c nodeName:}" failed. No retries permitted until 2026-09-17 23:06:49.090078743 +0000 UTC m=+47.968593967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-55kq8" (UID: "fecf9a2c-da73-4901-b5f7-b4b77148f28c") : secret "samples-operator-tls" not found
Sep 17 23:06:48.090216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090142    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:06:48.090216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090161    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:49.090143145 +0000 UTC m=+47.968658379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:06:48.090216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090172    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:48.090216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090192    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:49.090177104 +0000 UTC m=+47.968692331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:06:48.090216 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.090209    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:06:49.09019995 +0000 UTC m=+47.968715175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:48.190997 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:48.190961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:48.191165 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.191116    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:06:48.191215 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:48.191179    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:06:49.191163755 +0000 UTC m=+48.069679003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:06:49.048240 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.048136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p" event={"ID":"17aba131-696c-45c4-80bf-9f9e0367f891","Type":"ContainerStarted","Data":"000fa0ef4d8a8d89f30b59eee9b9f72bca5177e0ca04b421b807b4f820addef3"}
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.101529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.101663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.101696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.101725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.101850    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.101927    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:06:51.101909015 +0000 UTC m=+49.980424246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.102357    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.102361    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:51.102346663 +0000 UTC m=+49.980861901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.102410    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls podName:fecf9a2c-da73-4901-b5f7-b4b77148f28c nodeName:}" failed. No retries permitted until 2026-09-17 23:06:51.102397039 +0000 UTC m=+49.980912278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-55kq8" (UID: "fecf9a2c-da73-4901-b5f7-b4b77148f28c") : secret "samples-operator-tls" not found
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.102432    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:06:49.102528 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.102469    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:51.102458505 +0000 UTC m=+49.980973732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:06:49.202847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:49.202806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:49.203098 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.202977    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:06:49.203098 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:49.203038    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:06:51.203021426 +0000 UTC m=+50.081536656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:06:50.818724 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:50.818683    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:50.818742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:50.818831    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:50.818837    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:50.818842    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c6b758d6b-v5hq7: secret "image-registry-tls" not found
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:50.818902    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls podName:83144408-58fc-403f-84b6-350fc3b586fc nodeName:}" failed. No retries permitted until 2026-09-17 23:07:06.818887211 +0000 UTC m=+65.697402435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls") pod "dns-default-qf8fb" (UID: "83144408-58fc-403f-84b6-350fc3b586fc") : secret "dns-default-metrics-tls" not found
Sep 17 23:06:50.819160 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:50.819013    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls podName:80322da9-d276-4544-addd-861fec097dff nodeName:}" failed. No retries permitted until 2026-09-17 23:07:06.819001319 +0000 UTC m=+65.697516543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls") pod "image-registry-5c6b758d6b-v5hq7" (UID: "80322da9-d276-4544-addd-861fec097dff") : secret "image-registry-tls" not found
Sep 17 23:06:51.121976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:51.121875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:51.121976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:51.121932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:51.121976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:51.121960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:51.122027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122091    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.122069013 +0000 UTC m=+54.000584241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122120    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122120    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122167    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.122153855 +0000 UTC m=+54.000669115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122213    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls podName:fecf9a2c-da73-4901-b5f7-b4b77148f28c nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.122192989 +0000 UTC m=+54.000708240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-55kq8" (UID: "fecf9a2c-da73-4901-b5f7-b4b77148f28c") : secret "samples-operator-tls" not found
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122120    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:06:51.122271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.122277    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.122262897 +0000 UTC m=+54.000778145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:06:51.223040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:51.223002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:51.223235 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.223175    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:06:51.223308 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:51.223250    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.223230862 +0000 UTC m=+54.101746107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:06:54.067440 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.067344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4" event={"ID":"c837a464-f296-42e8-99be-f63a80056849","Type":"ContainerStarted","Data":"0459f045032b21189779a52b1dc9fd3fd4d88a0eff967cbc51ac62b3571ae0fb"}
Sep 17 23:06:54.069311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.069284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc" event={"ID":"9a408a4e-74a9-47b8-ba1d-cb0b13bc1074","Type":"ContainerStarted","Data":"7fe48a6b63a8f8db17acb788468945b1e3cc2301cda647fb3cad0acb4671efee"}
Sep 17 23:06:54.071794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.071767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp" event={"ID":"33529c70-632d-4090-931b-a861615b2f78","Type":"ContainerStarted","Data":"4e4db466fdea228be4f57e8989351cd713d6065fd06c89e788241f2f590d4de5"}
Sep 17 23:06:54.073362 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.073336    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf" event={"ID":"86a8e584-bf3b-491c-9d3a-4af608a972e2","Type":"ContainerStarted","Data":"6ed677d3b8eeacd04ce5f8fdb4eeba385b1b72db6cab27951e142a8d1a0830bc"}
Sep 17 23:06:54.075091 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.075069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p" event={"ID":"17aba131-696c-45c4-80bf-9f9e0367f891","Type":"ContainerStarted","Data":"c93f3f521ac6b6c71ade12e1a37faee3e51412a1b07e1513c911c627b3ce2083"}
Sep 17 23:06:54.076929 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.076910    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/0.log"
Sep 17 23:06:54.077036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.076948    2581 generic.go:356] "Generic (PLEG): container finished" podID="c431891f-26ac-4ca7-a0d6-7d761de8f49f" containerID="579d9ec2ec46b27488046a0c2b729687da43a178f45ee746696e346fe13dafa2" exitCode=255
Sep 17 23:06:54.077036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.076978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" event={"ID":"c431891f-26ac-4ca7-a0d6-7d761de8f49f","Type":"ContainerDied","Data":"579d9ec2ec46b27488046a0c2b729687da43a178f45ee746696e346fe13dafa2"}
Sep 17 23:06:54.077225 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.077208    2581 scope.go:117] "RemoveContainer" containerID="579d9ec2ec46b27488046a0c2b729687da43a178f45ee746696e346fe13dafa2"
Sep 17 23:06:54.105912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.105863    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-qm7v4" podStartSLOduration=1.290257664 podStartE2EDuration="7.105831487s" totalImagesPullingTime="5.815573823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:54.083962445 +0000 UTC m=+52.962477691" watchObservedRunningTime="2026-09-17 23:06:54.105831487 +0000 UTC m=+52.984346734"
Sep 17 23:06:54.106087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.106060    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp" podStartSLOduration=1.436692723 podStartE2EDuration="7.10603575s" totalImagesPullingTime="5.669343027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:54.104861907 +0000 UTC m=+52.983377155" watchObservedRunningTime="2026-09-17 23:06:54.10603575 +0000 UTC m=+52.984551000"
Sep 17 23:06:54.127822 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.127771    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-26rbc" podStartSLOduration=1.364852563 podStartE2EDuration="7.127750191s" totalImagesPullingTime="5.762897628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:54.125753963 +0000 UTC m=+53.004269213" watchObservedRunningTime="2026-09-17 23:06:54.127750191 +0000 UTC m=+53.006265438"
Sep 17 23:06:54.175002 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:54.174950    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf" podStartSLOduration=1.441035221 podStartE2EDuration="7.174929316s" totalImagesPullingTime="5.733894095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:54.152170921 +0000 UTC m=+53.030686167" watchObservedRunningTime="2026-09-17 23:06:54.174929316 +0000 UTC m=+53.053444563"
Sep 17 23:06:55.082831 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.082751    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:06:55.083312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.083290    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/0.log"
Sep 17 23:06:55.083373 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.083325    2581 generic.go:356] "Generic (PLEG): container finished" podID="c431891f-26ac-4ca7-a0d6-7d761de8f49f" containerID="adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1" exitCode=255
Sep 17 23:06:55.083452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.083426    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" event={"ID":"c431891f-26ac-4ca7-a0d6-7d761de8f49f","Type":"ContainerDied","Data":"adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1"}
Sep 17 23:06:55.083532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.083520    2581 scope.go:117] "RemoveContainer" containerID="579d9ec2ec46b27488046a0c2b729687da43a178f45ee746696e346fe13dafa2"
Sep 17 23:06:55.083624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.083611    2581 scope.go:117] "RemoveContainer" containerID="adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1"
Sep 17 23:06:55.083881 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.083754    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-nf7ww_openshift-console-operator(c431891f-26ac-4ca7-a0d6-7d761de8f49f)\"" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" podUID="c431891f-26ac-4ca7-a0d6-7d761de8f49f"
Sep 17 23:06:55.102453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.102400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p" podStartSLOduration=2.467096637 podStartE2EDuration="8.102378095s" totalImagesPullingTime="5.635281458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:54.200994099 +0000 UTC m=+53.079509348" watchObservedRunningTime="2026-09-17 23:06:55.102378095 +0000 UTC m=+53.980893343"
Sep 17 23:06:55.158138 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.158096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:06:55.158700 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.158678    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 23:06:55.158822 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.158750    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:55.158874 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.158852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:06:55.158924 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.158883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:06:55.158991 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.158976    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:55.159061 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.159031    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:07:03.15901477 +0000 UTC m=+62.037530001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:06:55.159130 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.159100    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls podName:fecf9a2c-da73-4901-b5f7-b4b77148f28c nodeName:}" failed. No retries permitted until 2026-09-17 23:07:03.159081229 +0000 UTC m=+62.037596461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-55kq8" (UID: "fecf9a2c-da73-4901-b5f7-b4b77148f28c") : secret "samples-operator-tls" not found
Sep 17 23:06:55.159370 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.159351    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:03.159334292 +0000 UTC m=+62.037849532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:06:55.159370 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.159365    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:06:55.159482 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.159400    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:03.1593886 +0000 UTC m=+62.037903829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:06:55.232142 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.229709    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zll26"]
Sep 17 23:06:55.234611 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.234581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.236976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.236953    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 23:06:55.237124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.237015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 23:06:55.237124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.237032    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bbrzm\""
Sep 17 23:06:55.246084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.245840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zll26"]
Sep 17 23:06:55.259944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.259913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.260106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.259983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:06:55.260106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.260088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee32f4a-11a3-42b0-9ada-a541e27ee165-data-volume\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.260234 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.260132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnx7n\" (UniqueName: \"kubernetes.io/projected/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-api-access-bnx7n\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.260234 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.260225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee32f4a-11a3-42b0-9ada-a541e27ee165-crio-socket\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.260332 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.260311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.260552 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.260508    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:06:55.260646 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.260598    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:07:03.260576741 +0000 UTC m=+62.139091974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:06:55.361622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee32f4a-11a3-42b0-9ada-a541e27ee165-data-volume\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnx7n\" (UniqueName: \"kubernetes.io/projected/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-api-access-bnx7n\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee32f4a-11a3-42b0-9ada-a541e27ee165-crio-socket\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8ee32f4a-11a3-42b0-9ada-a541e27ee165-crio-socket\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361925 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.361925 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.361918    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 23:06:55.362038 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.361975    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.861957439 +0000 UTC m=+54.740472677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : configmap "kube-rbac-proxy" not found
Sep 17 23:06:55.362038 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.361979    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:55.362038 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.362031    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:55.862015414 +0000 UTC m=+54.740530642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:55.362231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.361905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ee32f4a-11a3-42b0-9ada-a541e27ee165-data-volume\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.372621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.372590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnx7n\" (UniqueName: \"kubernetes.io/projected/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-api-access-bnx7n\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.709811 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.709782    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"]
Sep 17 23:06:55.712977 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.712956    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"
Sep 17 23:06:55.715568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.715547    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 23:06:55.715659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.715602    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kfrz9\""
Sep 17 23:06:55.715659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.715556    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 23:06:55.720970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.720953    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"]
Sep 17 23:06:55.766387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.766358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94w9n\" (UniqueName: \"kubernetes.io/projected/11f90086-5fc0-4c5d-ab4d-6d28187626e5-kube-api-access-94w9n\") pod \"migrator-76794cbd6c-hwkhc\" (UID: \"11f90086-5fc0-4c5d-ab4d-6d28187626e5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"
Sep 17 23:06:55.867678 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.867645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94w9n\" (UniqueName: \"kubernetes.io/projected/11f90086-5fc0-4c5d-ab4d-6d28187626e5-kube-api-access-94w9n\") pod \"migrator-76794cbd6c-hwkhc\" (UID: \"11f90086-5fc0-4c5d-ab4d-6d28187626e5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"
Sep 17 23:06:55.867833 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.867819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.867872 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.867842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:55.867950 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.867932    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 23:06:55.868000 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.867991    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:56.867976152 +0000 UTC m=+55.746491376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : configmap "kube-rbac-proxy" not found
Sep 17 23:06:55.868038 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.867938    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:55.868038 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:55.868030    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:56.868023928 +0000 UTC m=+55.746539152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:55.875871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:55.875838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94w9n\" (UniqueName: \"kubernetes.io/projected/11f90086-5fc0-4c5d-ab4d-6d28187626e5-kube-api-access-94w9n\") pod \"migrator-76794cbd6c-hwkhc\" (UID: \"11f90086-5fc0-4c5d-ab4d-6d28187626e5\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"
Sep 17 23:06:56.023092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.023006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"
Sep 17 23:06:56.090515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.090494    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:06:56.090932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.090913    2581 scope.go:117] "RemoveContainer" containerID="adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1"
Sep 17 23:06:56.091132 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:56.091110    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-nf7ww_openshift-console-operator(c431891f-26ac-4ca7-a0d6-7d761de8f49f)\"" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" podUID="c431891f-26ac-4ca7-a0d6-7d761de8f49f"
Sep 17 23:06:56.291384 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.291314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc"]
Sep 17 23:06:56.294232 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:56.294206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f90086_5fc0_4c5d_ab4d_6d28187626e5.slice/crio-45c013734f612b3f164b5ff4482caacf60ecb34d3882c5e8c2264d383ef5cc96 WatchSource:0}: Error finding container 45c013734f612b3f164b5ff4482caacf60ecb34d3882c5e8c2264d383ef5cc96: Status 404 returned error can't find the container with id 45c013734f612b3f164b5ff4482caacf60ecb34d3882c5e8c2264d383ef5cc96
Sep 17 23:06:56.610442 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.610369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzxrn_af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac/dns-node-resolver/0.log"
Sep 17 23:06:56.878147 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.878070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:56.878147 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:56.878113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:56.878377 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:56.878190    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 23:06:56.878377 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:56.878277    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:58.878255419 +0000 UTC m=+57.756770657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : configmap "kube-rbac-proxy" not found
Sep 17 23:06:56.878377 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:56.878292    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:56.878377 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:56.878330    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:06:58.878319307 +0000 UTC m=+57.756834546 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:57.097370 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.097334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc" event={"ID":"11f90086-5fc0-4c5d-ab4d-6d28187626e5","Type":"ContainerStarted","Data":"45c013734f612b3f164b5ff4482caacf60ecb34d3882c5e8c2264d383ef5cc96"}
Sep 17 23:06:57.410167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.410149    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f4x8q_f5956530-c1d2-4a28-9fb6-01eb44512b32/node-ca/0.log"
Sep 17 23:06:57.446316 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.446290    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mvcsj"]
Sep 17 23:06:57.450203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.450182    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.453957 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.453939    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 23:06:57.454520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.454501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 23:06:57.454590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.454565    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 23:06:57.455222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.455186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7fdwf\""
Sep 17 23:06:57.457135 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.456989    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 23:06:57.470749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.470727    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mvcsj"]
Sep 17 23:06:57.483557 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.483539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-cabundle\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.483669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.483572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59j7m\" (UniqueName: \"kubernetes.io/projected/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-kube-api-access-59j7m\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.483669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.483611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-key\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.584214 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.584165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-cabundle\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.584398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.584222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59j7m\" (UniqueName: \"kubernetes.io/projected/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-kube-api-access-59j7m\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.584398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.584291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-key\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.584954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.584928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-cabundle\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.586762 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.586742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-signing-key\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.594257 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.594236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59j7m\" (UniqueName: \"kubernetes.io/projected/2a30be0b-5ef5-4b14-a30c-154ad921d0f6-kube-api-access-59j7m\") pod \"service-ca-55f6fc7b86-mvcsj\" (UID: \"2a30be0b-5ef5-4b14-a30c-154ad921d0f6\") " pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:57.690295 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.690266    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:57.690457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.690313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:06:57.690647 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.690635    2581 scope.go:117] "RemoveContainer" containerID="adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1"
Sep 17 23:06:57.690794 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:57.690777    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-nf7ww_openshift-console-operator(c431891f-26ac-4ca7-a0d6-7d761de8f49f)\"" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" podUID="c431891f-26ac-4ca7-a0d6-7d761de8f49f"
Sep 17 23:06:57.773310 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:57.773274    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj"
Sep 17 23:06:58.010104 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.010002    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwvkr_496c7bf5-150e-4375-a256-46ad515115e1/serve-healthcheck-canary/0.log"
Sep 17 23:06:58.059638 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.059608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-mvcsj"]
Sep 17 23:06:58.064335 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:06:58.064309    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a30be0b_5ef5_4b14_a30c_154ad921d0f6.slice/crio-4df167c27ab280453b9b066d34ab8565d986aaa4cb58c06b841083fbde74528c WatchSource:0}: Error finding container 4df167c27ab280453b9b066d34ab8565d986aaa4cb58c06b841083fbde74528c: Status 404 returned error can't find the container with id 4df167c27ab280453b9b066d34ab8565d986aaa4cb58c06b841083fbde74528c
Sep 17 23:06:58.102392 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.102358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc" event={"ID":"11f90086-5fc0-4c5d-ab4d-6d28187626e5","Type":"ContainerStarted","Data":"205313bfc908fc34d37ec720b4ef3db3adcd6ef2e010e9604b6d6ccffc59a590"}
Sep 17 23:06:58.102769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.102421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc" event={"ID":"11f90086-5fc0-4c5d-ab4d-6d28187626e5","Type":"ContainerStarted","Data":"9bd6dcf9ae9fc53aaacdf0a82799e590643872a09c8b6cc2ed91f603cdfb8646"}
Sep 17 23:06:58.103601 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.103583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj" event={"ID":"2a30be0b-5ef5-4b14-a30c-154ad921d0f6","Type":"ContainerStarted","Data":"4df167c27ab280453b9b066d34ab8565d986aaa4cb58c06b841083fbde74528c"}
Sep 17 23:06:58.120580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.120538    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-hwkhc" podStartSLOduration=2.045348693 podStartE2EDuration="3.120521624s" totalImagesPullingTime="1.075172931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:58.119921175 +0000 UTC m=+56.998436424" watchObservedRunningTime="2026-09-17 23:06:58.120521624 +0000 UTC m=+56.999036906"
Sep 17 23:06:58.897255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.897218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:58.897255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:58.897254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:06:58.897509 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:58.897355    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 23:06:58.897509 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:58.897384    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:58.897509 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:58.897424    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:02.897408636 +0000 UTC m=+61.775923866 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : configmap "kube-rbac-proxy" not found
Sep 17 23:06:58.897509 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:06:58.897440    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:02.897434029 +0000 UTC m=+61.775949253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : secret "insights-runtime-extractor-tls" not found
Sep 17 23:06:59.110411 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:06:59.110366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj" event={"ID":"2a30be0b-5ef5-4b14-a30c-154ad921d0f6","Type":"ContainerStarted","Data":"ba53d320b8c0379d183738c51f66a8ead2e0416ad15b1d57dfa6bcd914bb496c"}
Sep 17 23:07:00.985910 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:00.985883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjvw9"
Sep 17 23:07:01.014522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:01.014472    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-mvcsj" podStartSLOduration=4.014457173 podStartE2EDuration="4.014457173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:06:59.129542648 +0000 UTC m=+58.008057893" watchObservedRunningTime="2026-09-17 23:07:01.014457173 +0000 UTC m=+59.892972418"
Sep 17 23:07:02.932646 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:02.932599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:02.932646 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:02.932641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:02.933119 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:02.932715    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 23:07:02.933119 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:02.932755    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 23:07:02.933119 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:02.932780    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:10.932765876 +0000 UTC m=+69.811281101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : configmap "kube-rbac-proxy" not found
Sep 17 23:07:02.933119 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:02.932795    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls podName:8ee32f4a-11a3-42b0-9ada-a541e27ee165 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:10.932789353 +0000 UTC m=+69.811304577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zll26" (UID: "8ee32f4a-11a3-42b0-9ada-a541e27ee165") : secret "insights-runtime-extractor-tls" not found
Sep 17 23:07:03.235221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.235122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:07:03.235386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.235252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:03.235386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.235285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:03.235386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.235318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:07:03.235499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.235403    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 23:07:03.235499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.235427    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:19.235411213 +0000 UTC m=+78.113926438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : configmap references non-existent config key: service-ca.crt
Sep 17 23:07:03.235499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.235427    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 23:07:03.235499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.235460    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs podName:ffa416ac-87d1-4c73-b12e-f8b20f487184 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:19.235446564 +0000 UTC m=+78.113961788 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs") pod "router-default-6454dbbfc8-27mq8" (UID: "ffa416ac-87d1-4c73-b12e-f8b20f487184") : secret "router-metrics-certs-default" not found
Sep 17 23:07:03.235499 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.235478    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls podName:0c9cf990-bfdc-4805-93c7-03a0ea99e72a nodeName:}" failed. No retries permitted until 2026-09-17 23:07:19.235467978 +0000 UTC m=+78.113983204 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-gr2ww" (UID: "0c9cf990-bfdc-4805-93c7-03a0ea99e72a") : secret "cluster-monitoring-operator-tls" not found
Sep 17 23:07:03.237640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.237612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fecf9a2c-da73-4901-b5f7-b4b77148f28c-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-55kq8\" (UID: \"fecf9a2c-da73-4901-b5f7-b4b77148f28c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:07:03.275703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.275675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-775zh\""
Sep 17 23:07:03.284325 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.284303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"
Sep 17 23:07:03.336554 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.336524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:07:03.336681 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.336668    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 17 23:07:03.336727 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:03.336718    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert podName:e4400476-2bbd-436e-8320-eb0ebfa05c3b nodeName:}" failed. No retries permitted until 2026-09-17 23:07:19.336705021 +0000 UTC m=+78.215220244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-mpvwd" (UID: "e4400476-2bbd-436e-8320-eb0ebfa05c3b") : secret "networking-console-plugin-cert" not found
Sep 17 23:07:03.556361 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:03.556288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8"]
Sep 17 23:07:04.128651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:04.128608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8" event={"ID":"fecf9a2c-da73-4901-b5f7-b4b77148f28c","Type":"ContainerStarted","Data":"a041e8b5b2f58dc849b4b77b6caf87b23c8b4f7033c7ee16bf6d473479a70455"}
Sep 17 23:07:06.137218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.137179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8" event={"ID":"fecf9a2c-da73-4901-b5f7-b4b77148f28c","Type":"ContainerStarted","Data":"f4f9feb04ba96d5d8d1ee8a52472410b366568cc89c6194dc5928746d4afa1bf"}
Sep 17 23:07:06.137678 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.137241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8" event={"ID":"fecf9a2c-da73-4901-b5f7-b4b77148f28c","Type":"ContainerStarted","Data":"096aac53f90141f8a1f669eb049291ac2d4360986334a294ff5c32b140f6e3b8"}
Sep 17 23:07:06.153723 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.153672    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-55kq8" podStartSLOduration=17.186536309 podStartE2EDuration="19.153650936s" totalImagesPullingTime="1.967114627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:06.153120167 +0000 UTC m=+65.031635412" watchObservedRunningTime="2026-09-17 23:07:06.153650936 +0000 UTC m=+65.032166182"
Sep 17 23:07:06.464357 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.464327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:07:06.464524 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.464362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:07:06.467009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.466989    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 23:07:06.467089 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.467015    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 23:07:06.477160 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.477140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0e212fef-9eb1-4b39-95dd-2f500579ff73-original-pull-secret\") pod \"global-pull-secret-syncer-9bc9s\" (UID: \"0e212fef-9eb1-4b39-95dd-2f500579ff73\") " pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:07:06.477267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.477141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bba79b0b-9db3-4ab5-90db-9881c2898a54-metrics-certs\") pod \"network-metrics-daemon-mm4gc\" (UID: \"bba79b0b-9db3-4ab5-90db-9881c2898a54\") " pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:07:06.565238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.565207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:07:06.567654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.567630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tthjd\" (UniqueName: \"kubernetes.io/projected/c5ea2ee2-c30e-4241-963b-a3979760d459-kube-api-access-tthjd\") pod \"network-check-target-bmwfh\" (UID: \"c5ea2ee2-c30e-4241-963b-a3979760d459\") " pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:07:06.669129 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.669098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p8cnd\""
Sep 17 23:07:06.674192 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.674176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9bc9s"
Sep 17 23:07:06.677259 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.677247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mm4gc"
Sep 17 23:07:06.682019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.682001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fkqjx\""
Sep 17 23:07:06.690115 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.690097    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:07:06.867917 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.867888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:07:06.868105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.867936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:07:06.870269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.870238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/83144408-58fc-403f-84b6-350fc3b586fc-metrics-tls\") pod \"dns-default-qf8fb\" (UID: \"83144408-58fc-403f-84b6-350fc3b586fc\") " pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:07:06.870387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.870244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"image-registry-5c6b758d6b-v5hq7\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") " pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:07:06.959455 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.959427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9bc9s"]
Sep 17 23:07:06.963418 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:06.963391    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e212fef_9eb1_4b39_95dd_2f500579ff73.slice/crio-3940bd73e5eedbcc088f9a258cc9e3b7b460906d18a232f1acff734aad95722d WatchSource:0}: Error finding container 3940bd73e5eedbcc088f9a258cc9e3b7b460906d18a232f1acff734aad95722d: Status 404 returned error can't find the container with id 3940bd73e5eedbcc088f9a258cc9e3b7b460906d18a232f1acff734aad95722d
Sep 17 23:07:06.965740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.965711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mm4gc"]
Sep 17 23:07:06.968143 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:06.968120    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba79b0b_9db3_4ab5_90db_9881c2898a54.slice/crio-1f28f27b7007088c5d352e863acb8dadf1119c9570d3f12b4be8ae6c0f3802cf WatchSource:0}: Error finding container 1f28f27b7007088c5d352e863acb8dadf1119c9570d3f12b4be8ae6c0f3802cf: Status 404 returned error can't find the container with id 1f28f27b7007088c5d352e863acb8dadf1119c9570d3f12b4be8ae6c0f3802cf
Sep 17 23:07:06.978307 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:06.978286    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmwfh"]
Sep 17 23:07:06.980818 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:06.980796    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ea2ee2_c30e_4241_963b_a3979760d459.slice/crio-cc08a0e8bc08fae5ab28183308521c983de2c1ce6c341670e987e31a431c25a8 WatchSource:0}: Error finding container cc08a0e8bc08fae5ab28183308521c983de2c1ce6c341670e987e31a431c25a8: Status 404 returned error can't find the container with id cc08a0e8bc08fae5ab28183308521c983de2c1ce6c341670e987e31a431c25a8
Sep 17 23:07:07.046832 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.046808    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dwfw7\""
Sep 17 23:07:07.055853 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.055834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:07:07.059028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.059008    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-62qw9\""
Sep 17 23:07:07.068123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.068102    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:07:07.141394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.141363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mm4gc" event={"ID":"bba79b0b-9db3-4ab5-90db-9881c2898a54","Type":"ContainerStarted","Data":"1f28f27b7007088c5d352e863acb8dadf1119c9570d3f12b4be8ae6c0f3802cf"}
Sep 17 23:07:07.143753 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.143719    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmwfh" event={"ID":"c5ea2ee2-c30e-4241-963b-a3979760d459","Type":"ContainerStarted","Data":"d430db63fa2912c3f991cf21c4e7dd639b9aada85ecc8c930b7e62558f001989"}
Sep 17 23:07:07.143887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.143780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmwfh" event={"ID":"c5ea2ee2-c30e-4241-963b-a3979760d459","Type":"ContainerStarted","Data":"cc08a0e8bc08fae5ab28183308521c983de2c1ce6c341670e987e31a431c25a8"}
Sep 17 23:07:07.143887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.143841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:07:07.145167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.145142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9bc9s" event={"ID":"0e212fef-9eb1-4b39-95dd-2f500579ff73","Type":"ContainerStarted","Data":"3940bd73e5eedbcc088f9a258cc9e3b7b460906d18a232f1acff734aad95722d"}
Sep 17 23:07:07.159228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.159189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bmwfh" podStartSLOduration=65.159176164 podStartE2EDuration="1m5.159176164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:07.158129899 +0000 UTC m=+66.036645145" watchObservedRunningTime="2026-09-17 23:07:07.159176164 +0000 UTC m=+66.037691409"
Sep 17 23:07:07.330429 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.330174    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:07:07.334433 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:07.334409    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80322da9_d276_4544_addd_861fec097dff.slice/crio-1254396f428383ee294f18c7cbe8448f33d9ac2716bdd5a93de5b1f457bd86a6 WatchSource:0}: Error finding container 1254396f428383ee294f18c7cbe8448f33d9ac2716bdd5a93de5b1f457bd86a6: Status 404 returned error can't find the container with id 1254396f428383ee294f18c7cbe8448f33d9ac2716bdd5a93de5b1f457bd86a6
Sep 17 23:07:07.345011 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:07.344986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qf8fb"]
Sep 17 23:07:07.347970 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:07.347948    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83144408_58fc_403f_84b6_350fc3b586fc.slice/crio-8a28c6500198f04aa50aef574dc7917dd0778bbb4dd3e822deaf0cae5a35e878 WatchSource:0}: Error finding container 8a28c6500198f04aa50aef574dc7917dd0778bbb4dd3e822deaf0cae5a35e878: Status 404 returned error can't find the container with id 8a28c6500198f04aa50aef574dc7917dd0778bbb4dd3e822deaf0cae5a35e878
Sep 17 23:07:08.152247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:08.152186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf8fb" event={"ID":"83144408-58fc-403f-84b6-350fc3b586fc","Type":"ContainerStarted","Data":"8a28c6500198f04aa50aef574dc7917dd0778bbb4dd3e822deaf0cae5a35e878"}
Sep 17 23:07:08.155204 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:08.155127    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" event={"ID":"80322da9-d276-4544-addd-861fec097dff","Type":"ContainerStarted","Data":"84c77b79b9362eb402b6e76112f2778e7d5c573752c67de3081fed81210c9ece"}
Sep 17 23:07:08.155204 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:08.155170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" event={"ID":"80322da9-d276-4544-addd-861fec097dff","Type":"ContainerStarted","Data":"1254396f428383ee294f18c7cbe8448f33d9ac2716bdd5a93de5b1f457bd86a6"}
Sep 17 23:07:09.162234 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:09.162187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mm4gc" event={"ID":"bba79b0b-9db3-4ab5-90db-9881c2898a54","Type":"ContainerStarted","Data":"76e3799104eb103bc9e5a5e3c2e232943e2ece1c23ec1c519a9e51c9d41854d0"}
Sep 17 23:07:09.162714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:09.162263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mm4gc" event={"ID":"bba79b0b-9db3-4ab5-90db-9881c2898a54","Type":"ContainerStarted","Data":"899b415abd1a2c832ce27dd0ab963ca594212ed58bf0cf518a7b530d1fb3012a"}
Sep 17 23:07:09.162714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:09.162701    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:07:09.180985 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:09.180932    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mm4gc" podStartSLOduration=65.8759987 podStartE2EDuration="1m7.180911475s" totalImagesPullingTime="1.304912775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:09.180030033 +0000 UTC m=+68.058545280" watchObservedRunningTime="2026-09-17 23:07:09.180911475 +0000 UTC m=+68.059426721"
Sep 17 23:07:09.181877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:09.181307    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" podStartSLOduration=67.181291643 podStartE2EDuration="1m7.181291643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:08.178439537 +0000 UTC m=+67.056954789" watchObservedRunningTime="2026-09-17 23:07:09.181291643 +0000 UTC m=+68.059806892"
Sep 17 23:07:10.169595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:10.169557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf8fb" event={"ID":"83144408-58fc-403f-84b6-350fc3b586fc","Type":"ContainerStarted","Data":"4f37f89980665c17d8bca4daf435fc4a911f1d06f461dcc39f44f031c25da8ee"}
Sep 17 23:07:10.169998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:10.169627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qf8fb" event={"ID":"83144408-58fc-403f-84b6-350fc3b586fc","Type":"ContainerStarted","Data":"8709215f52d34778d785c90bb9d9eb38aff26a293ef939973d45e7a3d1828065"}
Sep 17 23:07:10.169998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:10.169966    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:07:10.189022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:10.188969    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qf8fb" podStartSLOduration=34.139539205 podStartE2EDuration="36.188948073s" totalImagesPullingTime="2.049408868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:10.187619626 +0000 UTC m=+69.066134874" watchObservedRunningTime="2026-09-17 23:07:10.188948073 +0000 UTC m=+69.067463324"
Sep 17 23:07:11.007158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.007121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:11.007322 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.007164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:11.007626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.007606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8ee32f4a-11a3-42b0-9ada-a541e27ee165-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:11.009651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.009621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8ee32f4a-11a3-42b0-9ada-a541e27ee165-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zll26\" (UID: \"8ee32f4a-11a3-42b0-9ada-a541e27ee165\") " pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:11.152776 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.152754    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bbrzm\""
Sep 17 23:07:11.161143 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.161116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zll26"
Sep 17 23:07:11.176272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.176240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9bc9s" event={"ID":"0e212fef-9eb1-4b39-95dd-2f500579ff73","Type":"ContainerStarted","Data":"359fb3ed6da25d31f36186021bf931f6e1556a4039569aea6ea634e3601ddade"}
Sep 17 23:07:11.195472 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.195024    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9bc9s" podStartSLOduration=65.095091288 podStartE2EDuration="1m9.195008014s" totalImagesPullingTime="4.099916726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:11.193879622 +0000 UTC m=+70.072394870" watchObservedRunningTime="2026-09-17 23:07:11.195008014 +0000 UTC m=+70.073523313"
Sep 17 23:07:11.446590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:11.446568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zll26"]
Sep 17 23:07:11.448942 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:11.448916    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee32f4a_11a3_42b0_9ada_a541e27ee165.slice/crio-d44857fd5b21f6134f27c6edc02e35e75330640120b0293a4613df9c4d06a813 WatchSource:0}: Error finding container d44857fd5b21f6134f27c6edc02e35e75330640120b0293a4613df9c4d06a813: Status 404 returned error can't find the container with id d44857fd5b21f6134f27c6edc02e35e75330640120b0293a4613df9c4d06a813
Sep 17 23:07:12.182644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:12.182604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zll26" event={"ID":"8ee32f4a-11a3-42b0-9ada-a541e27ee165","Type":"ContainerStarted","Data":"d7eb6866eda28fdd89040c232148bebb1cbb4428d06234e9422ffea2b6173ace"}
Sep 17 23:07:12.183123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:12.182678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zll26" event={"ID":"8ee32f4a-11a3-42b0-9ada-a541e27ee165","Type":"ContainerStarted","Data":"d44857fd5b21f6134f27c6edc02e35e75330640120b0293a4613df9c4d06a813"}
Sep 17 23:07:12.654519 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:12.654449    2581 scope.go:117] "RemoveContainer" containerID="adfda515c46d4f76fad4a58f058b7d78c5737a9e0854165e38ff04e4ca14bbe1"
Sep 17 23:07:13.189106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.189076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:07:13.189565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.189184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" event={"ID":"c431891f-26ac-4ca7-a0d6-7d761de8f49f","Type":"ContainerStarted","Data":"52de7e6e2ef78f000003577e70f16b67bc608b6df2355d7f8ff54276e6f35f11"}
Sep 17 23:07:13.189734 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.189711    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:07:13.192330 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.192303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zll26" event={"ID":"8ee32f4a-11a3-42b0-9ada-a541e27ee165","Type":"ContainerStarted","Data":"ff28b50b53b34e2d696589925a315d8f930203fa0ca4de5fb7bba35033599884"}
Sep 17 23:07:13.206424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.206385    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww" podStartSLOduration=20.511955424 podStartE2EDuration="26.206362392s" totalImagesPullingTime="5.694406968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:13.20560473 +0000 UTC m=+72.084119976" watchObservedRunningTime="2026-09-17 23:07:13.206362392 +0000 UTC m=+72.084877679"
Sep 17 23:07:13.474554 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:13.474480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-nf7ww"
Sep 17 23:07:14.198002 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:14.197964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zll26" event={"ID":"8ee32f4a-11a3-42b0-9ada-a541e27ee165","Type":"ContainerStarted","Data":"a1da74e3f3894dec36a5a2c4e9f8cd866fca3380b6294108131e483a0e3163c3"}
Sep 17 23:07:14.226657 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:14.226564    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zll26" podStartSLOduration=16.840099103 podStartE2EDuration="19.226550949s" totalImagesPullingTime="2.386451846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:06:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:14.225416313 +0000 UTC m=+73.103931558" watchObservedRunningTime="2026-09-17 23:07:14.226550949 +0000 UTC m=+73.105066194"
Sep 17 23:07:19.270971 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.270932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:19.271354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.270977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:19.271354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.271005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:07:19.271592 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.271573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffa416ac-87d1-4c73-b12e-f8b20f487184-service-ca-bundle\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:19.273274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.273253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffa416ac-87d1-4c73-b12e-f8b20f487184-metrics-certs\") pod \"router-default-6454dbbfc8-27mq8\" (UID: \"ffa416ac-87d1-4c73-b12e-f8b20f487184\") " pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:19.273374 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.273290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0c9cf990-bfdc-4805-93c7-03a0ea99e72a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-gr2ww\" (UID: \"0c9cf990-bfdc-4805-93c7-03a0ea99e72a\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:07:19.372453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.372417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:07:19.374776 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.374734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e4400476-2bbd-436e-8320-eb0ebfa05c3b-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-mpvwd\" (UID: \"e4400476-2bbd-436e-8320-eb0ebfa05c3b\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:07:19.436704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.436679    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rnrqj\""
Sep 17 23:07:19.444433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.444414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:19.457601 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.457572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8bmwl\""
Sep 17 23:07:19.465342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.465321    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"
Sep 17 23:07:19.538065 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.538032    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fcxvx\""
Sep 17 23:07:19.545357 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.545337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"
Sep 17 23:07:19.719363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.719334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6454dbbfc8-27mq8"]
Sep 17 23:07:19.721605 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:19.721579    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa416ac_87d1_4c73_b12e_f8b20f487184.slice/crio-8e87dce6a75f864b213d979cd3b9e6bafd7806511da1199dcf9c0536f82eadbc WatchSource:0}: Error finding container 8e87dce6a75f864b213d979cd3b9e6bafd7806511da1199dcf9c0536f82eadbc: Status 404 returned error can't find the container with id 8e87dce6a75f864b213d979cd3b9e6bafd7806511da1199dcf9c0536f82eadbc
Sep 17 23:07:19.743408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.743388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww"]
Sep 17 23:07:19.761103 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:19.761067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9cf990_bfdc_4805_93c7_03a0ea99e72a.slice/crio-25032f80fee517ab212f532e9842494e68f4eb71d034fe8f776a8e497ff739d1 WatchSource:0}: Error finding container 25032f80fee517ab212f532e9842494e68f4eb71d034fe8f776a8e497ff739d1: Status 404 returned error can't find the container with id 25032f80fee517ab212f532e9842494e68f4eb71d034fe8f776a8e497ff739d1
Sep 17 23:07:19.813089 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:19.813066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd"]
Sep 17 23:07:19.815969 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:19.815945    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4400476_2bbd_436e_8320_eb0ebfa05c3b.slice/crio-81ae2121c9b34c4965fd7b0de8fe0642e4c705e06ec0fe035fa70309fd0113c7 WatchSource:0}: Error finding container 81ae2121c9b34c4965fd7b0de8fe0642e4c705e06ec0fe035fa70309fd0113c7: Status 404 returned error can't find the container with id 81ae2121c9b34c4965fd7b0de8fe0642e4c705e06ec0fe035fa70309fd0113c7
Sep 17 23:07:20.223481 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.223442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww" event={"ID":"0c9cf990-bfdc-4805-93c7-03a0ea99e72a","Type":"ContainerStarted","Data":"25032f80fee517ab212f532e9842494e68f4eb71d034fe8f776a8e497ff739d1"}
Sep 17 23:07:20.224905 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.224879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6454dbbfc8-27mq8" event={"ID":"ffa416ac-87d1-4c73-b12e-f8b20f487184","Type":"ContainerStarted","Data":"c98344861ab03f4614b0fb16c5ffd55c0c73b466b8e43fad917bbffdd8beb57a"}
Sep 17 23:07:20.225054 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.224915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6454dbbfc8-27mq8" event={"ID":"ffa416ac-87d1-4c73-b12e-f8b20f487184","Type":"ContainerStarted","Data":"8e87dce6a75f864b213d979cd3b9e6bafd7806511da1199dcf9c0536f82eadbc"}
Sep 17 23:07:20.226332 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.226304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd" event={"ID":"e4400476-2bbd-436e-8320-eb0ebfa05c3b","Type":"ContainerStarted","Data":"81ae2121c9b34c4965fd7b0de8fe0642e4c705e06ec0fe035fa70309fd0113c7"}
Sep 17 23:07:20.245151 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.245098    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6454dbbfc8-27mq8" podStartSLOduration=33.245083077 podStartE2EDuration="33.245083077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:20.24337682 +0000 UTC m=+79.121892094" watchObservedRunningTime="2026-09-17 23:07:20.245083077 +0000 UTC m=+79.123598323"
Sep 17 23:07:20.444846 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.444806    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:20.447775 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:20.447752    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:21.185558 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.185529    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qf8fb"
Sep 17 23:07:21.230755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.230720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:21.232240 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.232217    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6454dbbfc8-27mq8"
Sep 17 23:07:21.565947 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.565915    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"]
Sep 17 23:07:21.569408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.569383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.569788 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.569603    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"]
Sep 17 23:07:21.573161 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573041    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 23:07:21.573292 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573275    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.573435 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 23:07:21.573827 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573807    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 23:07:21.573886 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573813    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 23:07:21.573966 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.573950    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 23:07:21.574198 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.574179    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 23:07:21.574416 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.574395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 23:07:21.575798 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.575781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qvcbl\""
Sep 17 23:07:21.579308 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.579290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 17 23:07:21.592028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.592005    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"]
Sep 17 23:07:21.605529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.605472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"]
Sep 17 23:07:21.607274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.607253    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"]
Sep 17 23:07:21.615207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.615179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.617781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.617763    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 17 23:07:21.638345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.638315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"]
Sep 17 23:07:21.668902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.668874    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-6r2dn"]
Sep 17 23:07:21.671940 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.671925    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:21.674445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.674422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 23:07:21.678134 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.678115    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nf6ld\""
Sep 17 23:07:21.679086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.679071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 23:07:21.691423 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtgld\" (UniqueName: \"kubernetes.io/projected/5ca05f08-409a-4593-8c68-f7bd2466b42b-kube-api-access-mtgld\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691474    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcx9n\" (UniqueName: \"kubernetes.io/projected/c6208bce-aeb8-4be1-9567-0aa1033fffef-kube-api-access-rcx9n\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.691528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05f08-409a-4593-8c68-f7bd2466b42b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691698 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691698 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691637    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.691698 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6208bce-aeb8-4be1-9567-0aa1033fffef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.691844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzbns\" (UniqueName: \"kubernetes.io/projected/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-kube-api-access-zzbns\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.691844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.691844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.691795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-tmp\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.704308 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.704279    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-6r2dn"]
Sep 17 23:07:21.792362 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6208bce-aeb8-4be1-9567-0aa1033fffef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.792362 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzbns\" (UniqueName: \"kubernetes.io/projected/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-kube-api-access-zzbns\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.792581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.792581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.792581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-tmp\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.792581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.792581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtgld\" (UniqueName: \"kubernetes.io/projected/5ca05f08-409a-4593-8c68-f7bd2466b42b-kube-api-access-mtgld\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.792830 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcx9n\" (UniqueName: \"kubernetes.io/projected/c6208bce-aeb8-4be1-9567-0aa1033fffef-kube-api-access-rcx9n\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.792830 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05f08-409a-4593-8c68-f7bd2466b42b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.792929 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-tmp\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.792990 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.792962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.793077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.793028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvsmh\" (UniqueName: \"kubernetes.io/projected/1a808b69-c53d-4971-8608-64ef20c0e330-kube-api-access-kvsmh\") pod \"downloads-6594f4c75-6r2dn\" (UID: \"1a808b69-c53d-4971-8608-64ef20c0e330\") " pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:21.793683 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.793244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.793683 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.793555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca05f08-409a-4593-8c68-f7bd2466b42b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.795406 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.795335    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.795699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.795677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-ca\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.795757 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.795732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c6208bce-aeb8-4be1-9567-0aa1033fffef-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.796019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.796001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.796156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.796081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca05f08-409a-4593-8c68-f7bd2466b42b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.796488 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.796471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-klusterlet-config\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.801693 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.801673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzbns\" (UniqueName: \"kubernetes.io/projected/7db4d938-e5e9-4c21-99f9-0a3d3aad13d8-kube-api-access-zzbns\") pod \"klusterlet-addon-workmgr-54db98ff5c-hxxqm\" (UID: \"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:21.803956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.803932    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtgld\" (UniqueName: \"kubernetes.io/projected/5ca05f08-409a-4593-8c68-f7bd2466b42b-kube-api-access-mtgld\") pod \"cluster-proxy-proxy-agent-764bfd44b7-v7bj5\" (UID: \"5ca05f08-409a-4593-8c68-f7bd2466b42b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.804239 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.804222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcx9n\" (UniqueName: \"kubernetes.io/projected/c6208bce-aeb8-4be1-9567-0aa1033fffef-kube-api-access-rcx9n\") pod \"managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl\" (UID: \"c6208bce-aeb8-4be1-9567-0aa1033fffef\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:21.894393 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.894354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvsmh\" (UniqueName: \"kubernetes.io/projected/1a808b69-c53d-4971-8608-64ef20c0e330-kube-api-access-kvsmh\") pod \"downloads-6594f4c75-6r2dn\" (UID: \"1a808b69-c53d-4971-8608-64ef20c0e330\") " pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:21.898681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.898656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"
Sep 17 23:07:21.907375 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:21.907342    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvsmh\" (UniqueName: \"kubernetes.io/projected/1a808b69-c53d-4971-8608-64ef20c0e330-kube-api-access-kvsmh\") pod \"downloads-6594f4c75-6r2dn\" (UID: \"1a808b69-c53d-4971-8608-64ef20c0e330\") " pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:22.012239 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.012167    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"
Sep 17 23:07:22.045777 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.045744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:22.050788 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.050772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:22.179634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.179607    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5"]
Sep 17 23:07:22.181899 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:22.181870    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ca05f08_409a_4593_8c68_f7bd2466b42b.slice/crio-c872344aad2db4ba05a49faff46ceceeaf3d6be2092989cf99866c048e74cf9e WatchSource:0}: Error finding container c872344aad2db4ba05a49faff46ceceeaf3d6be2092989cf99866c048e74cf9e: Status 404 returned error can't find the container with id c872344aad2db4ba05a49faff46ceceeaf3d6be2092989cf99866c048e74cf9e
Sep 17 23:07:22.236863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.236643    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd" event={"ID":"e4400476-2bbd-436e-8320-eb0ebfa05c3b","Type":"ContainerStarted","Data":"8d912487f5177e21a29e4a772a55f358d9460134f37914ff05eec44e11de9a26"}
Sep 17 23:07:22.238436 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.238409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww" event={"ID":"0c9cf990-bfdc-4805-93c7-03a0ea99e72a","Type":"ContainerStarted","Data":"27e9c34419a4143565090b55844701516b2f7e350e8e3fdd31d94f67c4996581"}
Sep 17 23:07:22.239648 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.239621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5" event={"ID":"5ca05f08-409a-4593-8c68-f7bd2466b42b","Type":"ContainerStarted","Data":"c872344aad2db4ba05a49faff46ceceeaf3d6be2092989cf99866c048e74cf9e"}
Sep 17 23:07:22.259881 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.259850    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"]
Sep 17 23:07:22.260386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.260341    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-mpvwd" podStartSLOduration=33.504298285 podStartE2EDuration="35.260325243s" totalImagesPullingTime="1.756026958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:22.258366425 +0000 UTC m=+81.136881672" watchObservedRunningTime="2026-09-17 23:07:22.260325243 +0000 UTC m=+81.138840491"
Sep 17 23:07:22.264496 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.264447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:22.266806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.266786    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 17 23:07:22.267095 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.267075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pvwjd\""
Sep 17 23:07:22.281192 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.281161    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"]
Sep 17 23:07:22.287931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.287866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-gr2ww" podStartSLOduration=33.472442496 podStartE2EDuration="35.287846525s" totalImagesPullingTime="1.815404029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:22.286929415 +0000 UTC m=+81.165444661" watchObservedRunningTime="2026-09-17 23:07:22.287846525 +0000 UTC m=+81.166361775"
Sep 17 23:07:22.293951 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.293920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl"]
Sep 17 23:07:22.296745 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:22.296722    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6208bce_aeb8_4be1_9567_0aa1033fffef.slice/crio-c0f7a8de50aca44bae6cccfaee108da7fddc513dfc4544048d30a72df08dd99f WatchSource:0}: Error finding container c0f7a8de50aca44bae6cccfaee108da7fddc513dfc4544048d30a72df08dd99f: Status 404 returned error can't find the container with id c0f7a8de50aca44bae6cccfaee108da7fddc513dfc4544048d30a72df08dd99f
Sep 17 23:07:22.377963 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.377935    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"]
Sep 17 23:07:22.381136 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:22.381102    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db4d938_e5e9_4c21_99f9_0a3d3aad13d8.slice/crio-869ff75c1ac598333f3c5a6b4d343936d52240d3a8eb9ed28a15324e3d800e91 WatchSource:0}: Error finding container 869ff75c1ac598333f3c5a6b4d343936d52240d3a8eb9ed28a15324e3d800e91: Status 404 returned error can't find the container with id 869ff75c1ac598333f3c5a6b4d343936d52240d3a8eb9ed28a15324e3d800e91
Sep 17 23:07:22.385239 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:22.385215    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a808b69_c53d_4971_8608_64ef20c0e330.slice/crio-e2bac2a67303cd719293c7877d37079f7f9657d871a32234952b8e8b594a7d79 WatchSource:0}: Error finding container e2bac2a67303cd719293c7877d37079f7f9657d871a32234952b8e8b594a7d79: Status 404 returned error can't find the container with id e2bac2a67303cd719293c7877d37079f7f9657d871a32234952b8e8b594a7d79
Sep 17 23:07:22.385648 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.385626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-6r2dn"]
Sep 17 23:07:22.400949 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.400923    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e6e0dfa-d025-4abd-b4ff-ac49954de4b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2cl85\" (UID: \"5e6e0dfa-d025-4abd-b4ff-ac49954de4b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:22.501428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.501390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e6e0dfa-d025-4abd-b4ff-ac49954de4b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2cl85\" (UID: \"5e6e0dfa-d025-4abd-b4ff-ac49954de4b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:22.503821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.503793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5e6e0dfa-d025-4abd-b4ff-ac49954de4b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-2cl85\" (UID: \"5e6e0dfa-d025-4abd-b4ff-ac49954de4b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:22.575911 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.575832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:22.865070 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:22.864951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"]
Sep 17 23:07:22.867710 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:22.867682    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6e0dfa_d025_4abd_b4ff_ac49954de4b8.slice/crio-79396634b2e91cdd8b27c6d3c118d8204d33f246f00504378b8924f09ccf7feb WatchSource:0}: Error finding container 79396634b2e91cdd8b27c6d3c118d8204d33f246f00504378b8924f09ccf7feb: Status 404 returned error can't find the container with id 79396634b2e91cdd8b27c6d3c118d8204d33f246f00504378b8924f09ccf7feb
Sep 17 23:07:23.248254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:23.248214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-6r2dn" event={"ID":"1a808b69-c53d-4971-8608-64ef20c0e330","Type":"ContainerStarted","Data":"e2bac2a67303cd719293c7877d37079f7f9657d871a32234952b8e8b594a7d79"}
Sep 17 23:07:23.252153 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:23.252116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl" event={"ID":"c6208bce-aeb8-4be1-9567-0aa1033fffef","Type":"ContainerStarted","Data":"c0f7a8de50aca44bae6cccfaee108da7fddc513dfc4544048d30a72df08dd99f"}
Sep 17 23:07:23.254587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:23.254541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85" event={"ID":"5e6e0dfa-d025-4abd-b4ff-ac49954de4b8","Type":"ContainerStarted","Data":"79396634b2e91cdd8b27c6d3c118d8204d33f246f00504378b8924f09ccf7feb"}
Sep 17 23:07:23.257102 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:23.257071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm" event={"ID":"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8","Type":"ContainerStarted","Data":"869ff75c1ac598333f3c5a6b4d343936d52240d3a8eb9ed28a15324e3d800e91"}
Sep 17 23:07:27.061961 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:27.061809    2581 patch_prober.go:28] interesting pod/image-registry-5c6b758d6b-v5hq7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 23:07:27.061961 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:27.061877    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" podUID="80322da9-d276-4544-addd-861fec097dff" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:07:30.176681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:30.176636    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:07:31.305530 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.305090    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85" event={"ID":"5e6e0dfa-d025-4abd-b4ff-ac49954de4b8","Type":"ContainerStarted","Data":"a38713ecc05f09a08a54ee472289d1f233641e326a5f3aeec50eb202129e77bc"}
Sep 17 23:07:31.305530 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.305314    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:31.307460 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.307429    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm" event={"ID":"7db4d938-e5e9-4c21-99f9-0a3d3aad13d8","Type":"ContainerStarted","Data":"9a9489814c8dc3811a694d707cb03ad6ec1d8e47f16898755f02d68236d55c52"}
Sep 17 23:07:31.307892 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.307819    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:31.309512 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.309476    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm"
Sep 17 23:07:31.310253 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.310226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5" event={"ID":"5ca05f08-409a-4593-8c68-f7bd2466b42b","Type":"ContainerStarted","Data":"398f4c1e9e5f2a51be56b139294e31449b01c891c376b42ec6ea9c296c1f41ba"}
Sep 17 23:07:31.310365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.310267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5" event={"ID":"5ca05f08-409a-4593-8c68-f7bd2466b42b","Type":"ContainerStarted","Data":"fcd7e4373c2b4f00d360e6219d24a138400f8c7fe50ec343f0ab58ceef509785"}
Sep 17 23:07:31.310365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.310284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5" event={"ID":"5ca05f08-409a-4593-8c68-f7bd2466b42b","Type":"ContainerStarted","Data":"3443cd189007cca3a0cc7e994bd71aab3245ee8810becd41b436a69ada7840db"}
Sep 17 23:07:31.311279 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.311261    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85"
Sep 17 23:07:31.312185 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.312148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl" event={"ID":"c6208bce-aeb8-4be1-9567-0aa1033fffef","Type":"ContainerStarted","Data":"2fee2bf5822de5917bd99e1d3a79487b62c3643d465a4e3768ee531d986bd3a7"}
Sep 17 23:07:31.322260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.322215    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-2cl85" podStartSLOduration=1.57918501 podStartE2EDuration="9.322199656s" totalImagesPullingTime="7.743014646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:31.320711865 +0000 UTC m=+90.199227115" watchObservedRunningTime="2026-09-17 23:07:31.322199656 +0000 UTC m=+90.200714904"
Sep 17 23:07:31.337994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.337942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-54db98ff5c-hxxqm" podStartSLOduration=2.080078157 podStartE2EDuration="10.337924158s" totalImagesPullingTime="8.257846001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:31.336323575 +0000 UTC m=+90.214838823" watchObservedRunningTime="2026-09-17 23:07:31.337924158 +0000 UTC m=+90.216439404"
Sep 17 23:07:31.373565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.373505    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-764bfd44b7-v7bj5" podStartSLOduration=1.919182818 podStartE2EDuration="10.373480667s" totalImagesPullingTime="8.454297849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:31.371442406 +0000 UTC m=+90.249957649" watchObservedRunningTime="2026-09-17 23:07:31.373480667 +0000 UTC m=+90.251995916"
Sep 17 23:07:31.388128 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:31.388071    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76f8c6ffc8-fbkrl" podStartSLOduration=2.070633361 podStartE2EDuration="10.388025131s" totalImagesPullingTime="8.31739177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:31.386489443 +0000 UTC m=+90.265004692" watchObservedRunningTime="2026-09-17 23:07:31.388025131 +0000 UTC m=+90.266540378"
Sep 17 23:07:36.735331 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.733678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9phh7"]
Sep 17 23:07:36.739839 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.739592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.742183 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.742157    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 23:07:36.742298 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.742267    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5vsd4\""
Sep 17 23:07:36.742417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.742157    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 23:07:36.743307 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.743268    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 23:07:36.744296 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.744276    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 23:07:36.836301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-metrics-client-ca\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-wtmp\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-root\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-sys\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-textfile\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74wmj\" (UniqueName: \"kubernetes.io/projected/6704d067-80b4-45d5-9ce6-9d70cf494827-kube-api-access-74wmj\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836782 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.836782 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.836714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-metrics-client-ca\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-wtmp\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-root\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-sys\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-textfile\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74wmj\" (UniqueName: \"kubernetes.io/projected/6704d067-80b4-45d5-9ce6-9d70cf494827-kube-api-access-74wmj\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-metrics-client-ca\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939063 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.938836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-sys\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.939264    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-accelerators-collector-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.939398    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-wtmp\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.939437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6704d067-80b4-45d5-9ce6-9d70cf494827-root\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:36.939518    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.939538    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-textfile\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.939708 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:36.939578    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls podName:6704d067-80b4-45d5-9ce6-9d70cf494827 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:37.439560183 +0000 UTC m=+96.318075414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls") pod "node-exporter-9phh7" (UID: "6704d067-80b4-45d5-9ce6-9d70cf494827") : secret "node-exporter-tls" not found
Sep 17 23:07:36.945937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.945910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:36.948772 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:36.948750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74wmj\" (UniqueName: \"kubernetes.io/projected/6704d067-80b4-45d5-9ce6-9d70cf494827-kube-api-access-74wmj\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:37.443789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:37.443742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:37.443969 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:37.443879    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 23:07:37.443969 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:07:37.443963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls podName:6704d067-80b4-45d5-9ce6-9d70cf494827 nodeName:}" failed. No retries permitted until 2026-09-17 23:07:38.443940762 +0000 UTC m=+97.322456001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls") pod "node-exporter-9phh7" (UID: "6704d067-80b4-45d5-9ce6-9d70cf494827") : secret "node-exporter-tls" not found
Sep 17 23:07:38.158470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:38.158438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bmwfh"
Sep 17 23:07:38.452592 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:38.452471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:38.455150 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:38.455123    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6704d067-80b4-45d5-9ce6-9d70cf494827-node-exporter-tls\") pod \"node-exporter-9phh7\" (UID: \"6704d067-80b4-45d5-9ce6-9d70cf494827\") " pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:38.552098 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:38.552035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9phh7"
Sep 17 23:07:40.842339 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:07:40.842310    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6704d067_80b4_45d5_9ce6_9d70cf494827.slice/crio-2ff2408a13fd2634285d70876dc4b1ff11cd65817e377d2467e20e91ece481ad WatchSource:0}: Error finding container 2ff2408a13fd2634285d70876dc4b1ff11cd65817e377d2467e20e91ece481ad: Status 404 returned error can't find the container with id 2ff2408a13fd2634285d70876dc4b1ff11cd65817e377d2467e20e91ece481ad
Sep 17 23:07:41.359869 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.359828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-6r2dn" event={"ID":"1a808b69-c53d-4971-8608-64ef20c0e330","Type":"ContainerStarted","Data":"db606afb46c9946e5156cda33874fb7640161a130f41940588e36137f684af47"}
Sep 17 23:07:41.360071 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.360041    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:41.361722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.361687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phh7" event={"ID":"6704d067-80b4-45d5-9ce6-9d70cf494827","Type":"ContainerStarted","Data":"2ff2408a13fd2634285d70876dc4b1ff11cd65817e377d2467e20e91ece481ad"}
Sep 17 23:07:41.361991 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.361969    2581 patch_prober.go:28] interesting pod/downloads-6594f4c75-6r2dn container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused" start-of-body=
Sep 17 23:07:41.362072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.362018    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6594f4c75-6r2dn" podUID="1a808b69-c53d-4971-8608-64ef20c0e330" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.25:8080/\": dial tcp 10.132.0.25:8080: connect: connection refused"
Sep 17 23:07:41.380199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:41.380144    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-6r2dn" podStartSLOduration=1.5671716409999998 podStartE2EDuration="20.380125312s" totalImagesPullingTime="18.812953671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:41.37853146 +0000 UTC m=+100.257046705" watchObservedRunningTime="2026-09-17 23:07:41.380125312 +0000 UTC m=+100.258640561"
Sep 17 23:07:42.368140 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:42.368101    2581 generic.go:356] "Generic (PLEG): container finished" podID="6704d067-80b4-45d5-9ce6-9d70cf494827" containerID="e67436e23f1ad6cc65d0c86231e2375f8aad2dc348edc17fdbad67881561712c" exitCode=0
Sep 17 23:07:42.368605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:42.368195    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phh7" event={"ID":"6704d067-80b4-45d5-9ce6-9d70cf494827","Type":"ContainerDied","Data":"e67436e23f1ad6cc65d0c86231e2375f8aad2dc348edc17fdbad67881561712c"}
Sep 17 23:07:42.385743 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:42.385720    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-6r2dn"
Sep 17 23:07:43.375903 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:43.375858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phh7" event={"ID":"6704d067-80b4-45d5-9ce6-9d70cf494827","Type":"ContainerStarted","Data":"c4c9efd96e42588565c99a655f8bc5919b5c65fce91ffec431dde07e9ad5aa79"}
Sep 17 23:07:43.376480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:43.375928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9phh7" event={"ID":"6704d067-80b4-45d5-9ce6-9d70cf494827","Type":"ContainerStarted","Data":"70c506dff02cb5298f965620dc736288c74bbdf9cc20e0a35ff0fa52e7d7a0fa"}
Sep 17 23:07:43.398429 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:43.398364    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9phh7" podStartSLOduration=6.320797345 podStartE2EDuration="7.398343052s" totalImagesPullingTime="988.878484ms" totalInitContainerRuntime="88.667223ms" isStatefulPod=true podCreationTimestamp="2026-09-17 23:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:07:43.397419182 +0000 UTC m=+102.275934666" watchObservedRunningTime="2026-09-17 23:07:43.398343052 +0000 UTC m=+102.276858300"
Sep 17 23:07:46.348857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:07:46.348822    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:08:05.466079 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:05.466027    2581 generic.go:356] "Generic (PLEG): container finished" podID="17aba131-696c-45c4-80bf-9f9e0367f891" containerID="c93f3f521ac6b6c71ade12e1a37faee3e51412a1b07e1513c911c627b3ce2083" exitCode=0
Sep 17 23:08:05.466607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:05.466104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p" event={"ID":"17aba131-696c-45c4-80bf-9f9e0367f891","Type":"ContainerDied","Data":"c93f3f521ac6b6c71ade12e1a37faee3e51412a1b07e1513c911c627b3ce2083"}
Sep 17 23:08:05.466607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:05.466506    2581 scope.go:117] "RemoveContainer" containerID="c93f3f521ac6b6c71ade12e1a37faee3e51412a1b07e1513c911c627b3ce2083"
Sep 17 23:08:06.471409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:06.471378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-k7z6p" event={"ID":"17aba131-696c-45c4-80bf-9f9e0367f891","Type":"ContainerStarted","Data":"1a44c6aec423cd2fb8e8c792d0a2214e650c27c4e34ec6d696feed9e49ac26e6"}
Sep 17 23:08:10.488082 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:10.488028    2581 generic.go:356] "Generic (PLEG): container finished" podID="86a8e584-bf3b-491c-9d3a-4af608a972e2" containerID="6ed677d3b8eeacd04ce5f8fdb4eeba385b1b72db6cab27951e142a8d1a0830bc" exitCode=0
Sep 17 23:08:10.488577 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:10.488103    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf" event={"ID":"86a8e584-bf3b-491c-9d3a-4af608a972e2","Type":"ContainerDied","Data":"6ed677d3b8eeacd04ce5f8fdb4eeba385b1b72db6cab27951e142a8d1a0830bc"}
Sep 17 23:08:10.488577 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:10.488434    2581 scope.go:117] "RemoveContainer" containerID="6ed677d3b8eeacd04ce5f8fdb4eeba385b1b72db6cab27951e142a8d1a0830bc"
Sep 17 23:08:11.182184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.182159    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454dbbfc8-27mq8_ffa416ac-87d1-4c73-b12e-f8b20f487184/router/0.log"
Sep 17 23:08:11.195539 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.195515    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwvkr_496c7bf5-150e-4375-a256-46ad515115e1/serve-healthcheck-canary/0.log"
Sep 17 23:08:11.371457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.371413    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" podUID="80322da9-d276-4544-addd-861fec097dff" containerName="registry" containerID="cri-o://84c77b79b9362eb402b6e76112f2778e7d5c573752c67de3081fed81210c9ece" gracePeriod=30
Sep 17 23:08:11.493658 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.493582    2581 generic.go:356] "Generic (PLEG): container finished" podID="80322da9-d276-4544-addd-861fec097dff" containerID="84c77b79b9362eb402b6e76112f2778e7d5c573752c67de3081fed81210c9ece" exitCode=0
Sep 17 23:08:11.494008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.493651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" event={"ID":"80322da9-d276-4544-addd-861fec097dff","Type":"ContainerDied","Data":"84c77b79b9362eb402b6e76112f2778e7d5c573752c67de3081fed81210c9ece"}
Sep 17 23:08:11.495534 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.495513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-6f9c644dd9-p26gf" event={"ID":"86a8e584-bf3b-491c-9d3a-4af608a972e2","Type":"ContainerStarted","Data":"86332e9acfba67803bdc79ed6df13fcf053e629288177a6b67b457f982e165da"}
Sep 17 23:08:11.658803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.658781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:08:11.741853 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741820    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.741853 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741854    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741923    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dvqf\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741966    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.741985    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.742003    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742087 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.742070    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets\") pod \"80322da9-d276-4544-addd-861fec097dff\" (UID: \"80322da9-d276-4544-addd-861fec097dff\") "
Sep 17 23:08:11.742459 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.742430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:08:11.742794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.742757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:08:11.744472 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.744410    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:08:11.744591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.744569    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:08:11.744668 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.744626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:08:11.744725 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.744707    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf" (OuterVolumeSpecName: "kube-api-access-9dvqf") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "kube-api-access-9dvqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:08:11.744954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.744928    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:08:11.750690 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.750666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "80322da9-d276-4544-addd-861fec097dff" (UID: "80322da9-d276-4544-addd-861fec097dff"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:08:11.842907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842876    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80322da9-d276-4544-addd-861fec097dff-ca-trust-extracted\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.842907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842903    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dvqf\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-kube-api-access-9dvqf\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842915    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-image-registry-private-configuration\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842925    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-registry-certificates\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842934    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-registry-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842942    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80322da9-d276-4544-addd-861fec097dff-installation-pull-secrets\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842950    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80322da9-d276-4544-addd-861fec097dff-bound-sa-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:11.843107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:11.842958    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80322da9-d276-4544-addd-861fec097dff-trusted-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:08:12.500864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:12.500841    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7"
Sep 17 23:08:12.501260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:12.500842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c6b758d6b-v5hq7" event={"ID":"80322da9-d276-4544-addd-861fec097dff","Type":"ContainerDied","Data":"1254396f428383ee294f18c7cbe8448f33d9ac2716bdd5a93de5b1f457bd86a6"}
Sep 17 23:08:12.501260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:12.500995    2581 scope.go:117] "RemoveContainer" containerID="84c77b79b9362eb402b6e76112f2778e7d5c573752c67de3081fed81210c9ece"
Sep 17 23:08:12.521813 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:12.521790    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:08:12.527341 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:12.527321    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c6b758d6b-v5hq7"]
Sep 17 23:08:13.659368 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:13.659337    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80322da9-d276-4544-addd-861fec097dff" path="/var/lib/kubelet/pods/80322da9-d276-4544-addd-861fec097dff/volumes"
Sep 17 23:08:20.533501 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:20.533467    2581 generic.go:356] "Generic (PLEG): container finished" podID="33529c70-632d-4090-931b-a861615b2f78" containerID="4e4db466fdea228be4f57e8989351cd713d6065fd06c89e788241f2f590d4de5" exitCode=0
Sep 17 23:08:20.533894 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:20.533540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp" event={"ID":"33529c70-632d-4090-931b-a861615b2f78","Type":"ContainerDied","Data":"4e4db466fdea228be4f57e8989351cd713d6065fd06c89e788241f2f590d4de5"}
Sep 17 23:08:20.533894 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:20.533843    2581 scope.go:117] "RemoveContainer" containerID="4e4db466fdea228be4f57e8989351cd713d6065fd06c89e788241f2f590d4de5"
Sep 17 23:08:21.540106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:08:21.540075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-26ccp" event={"ID":"33529c70-632d-4090-931b-a861615b2f78","Type":"ContainerStarted","Data":"4f87340fc81b442ac192f28bdbe1fa455b16252a7d9339829be7d60494717632"}
Sep 17 23:10:56.057974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.057941    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"]
Sep 17 23:10:56.058427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.058281    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80322da9-d276-4544-addd-861fec097dff" containerName="registry"
Sep 17 23:10:56.058427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.058293    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="80322da9-d276-4544-addd-861fec097dff" containerName="registry"
Sep 17 23:10:56.058427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.058360    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="80322da9-d276-4544-addd-861fec097dff" containerName="registry"
Sep 17 23:10:56.061274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.061256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.064072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.064034    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 23:10:56.064232 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.064071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 23:10:56.064377 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.064364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 23:10:56.064431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.064376    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 23:10:56.064818 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.064798    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lj7s7\""
Sep 17 23:10:56.076055 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.076022    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"]
Sep 17 23:10:56.226999 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.226962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.226999 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.226998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdvh\" (UniqueName: \"kubernetes.io/projected/97047ff6-810a-453c-bc81-14f8590e4af3-kube-api-access-swdvh\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.227238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.227095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-manifests\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.227238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.227135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-tmp\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.227238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.227180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328579 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-manifests\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328579 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-tmp\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328579 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328579 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swdvh\" (UniqueName: \"kubernetes.io/projected/97047ff6-810a-453c-bc81-14f8590e4af3-kube-api-access-swdvh\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.328984 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.328961    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-manifests\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.330932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.330910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/97047ff6-810a-453c-bc81-14f8590e4af3-tmp\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.331180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.331161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.331257 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.331205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97047ff6-810a-453c-bc81-14f8590e4af3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.336474 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.336449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdvh\" (UniqueName: \"kubernetes.io/projected/97047ff6-810a-453c-bc81-14f8590e4af3-kube-api-access-swdvh\") pod \"opendatahub-operator-controller-manager-5d5976b594-9gf4w\" (UID: \"97047ff6-810a-453c-bc81-14f8590e4af3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.371388 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.371348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:10:56.653469 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:56.653375    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"]
Sep 17 23:10:56.656436 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:10:56.656401    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97047ff6_810a_453c_bc81_14f8590e4af3.slice/crio-bb95ab2d3ed6c01e35344d60e9c7a1adf7b87c57c730db44241128230ed6df44 WatchSource:0}: Error finding container bb95ab2d3ed6c01e35344d60e9c7a1adf7b87c57c730db44241128230ed6df44: Status 404 returned error can't find the container with id bb95ab2d3ed6c01e35344d60e9c7a1adf7b87c57c730db44241128230ed6df44
Sep 17 23:10:57.156472 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:10:57.156439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w" event={"ID":"97047ff6-810a-453c-bc81-14f8590e4af3","Type":"ContainerStarted","Data":"bb95ab2d3ed6c01e35344d60e9c7a1adf7b87c57c730db44241128230ed6df44"}
Sep 17 23:11:00.173769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:00.173728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w" event={"ID":"97047ff6-810a-453c-bc81-14f8590e4af3","Type":"ContainerStarted","Data":"02c64a53bae2ac80472138fa36e0a1be408b0521e69acc5b41e9b23287c2c8bf"}
Sep 17 23:11:01.179802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:01.179760    2581 generic.go:356] "Generic (PLEG): container finished" podID="97047ff6-810a-453c-bc81-14f8590e4af3" containerID="02c64a53bae2ac80472138fa36e0a1be408b0521e69acc5b41e9b23287c2c8bf" exitCode=0
Sep 17 23:11:01.180211 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:01.179835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w" event={"ID":"97047ff6-810a-453c-bc81-14f8590e4af3","Type":"ContainerDied","Data":"02c64a53bae2ac80472138fa36e0a1be408b0521e69acc5b41e9b23287c2c8bf"}
Sep 17 23:11:01.541143 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:01.541113    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:11:01.546793 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:01.546773    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:11:01.553600 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:01.553579    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 23:11:02.186236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:02.186191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w" event={"ID":"97047ff6-810a-453c-bc81-14f8590e4af3","Type":"ContainerStarted","Data":"b3bb752177a3151efab10cfaebe235148483d00e506a631d1e30c9a786eda6c5"}
Sep 17 23:11:02.186829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:02.186292    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:11:02.211338 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:02.211280    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w" podStartSLOduration=1.73864113 podStartE2EDuration="6.211262127s" totalImagesPullingTime="3.376748439s" totalInitContainerRuntime="1.095872558s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:10:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:02.209552641 +0000 UTC m=+301.088067890" watchObservedRunningTime="2026-09-17 23:11:02.211262127 +0000 UTC m=+301.089777372"
Sep 17 23:11:13.192135 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:13.192104    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5976b594-9gf4w"
Sep 17 23:11:15.451411 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.451376    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"]
Sep 17 23:11:15.462649 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.462615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.465605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.465570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 23:11:15.465605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.465570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 23:11:15.472530 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.472497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tls-certs\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.472671 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.472547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tmp\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.472671 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.472583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6td52\" (UniqueName: \"kubernetes.io/projected/3a5fb108-a3e1-4326-968f-d854ea5f38f0-kube-api-access-6td52\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.473577 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.473554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"]
Sep 17 23:11:15.573208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.573173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tls-certs\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.573208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.573210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tmp\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.573448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.573242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6td52\" (UniqueName: \"kubernetes.io/projected/3a5fb108-a3e1-4326-968f-d854ea5f38f0-kube-api-access-6td52\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.575590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.575560    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tmp\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.575897 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.575876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a5fb108-a3e1-4326-968f-d854ea5f38f0-tls-certs\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.595022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.594995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6td52\" (UniqueName: \"kubernetes.io/projected/3a5fb108-a3e1-4326-968f-d854ea5f38f0-kube-api-access-6td52\") pod \"kube-auth-proxy-55b8d65647-rj8qn\" (UID: \"3a5fb108-a3e1-4326-968f-d854ea5f38f0\") " pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:15.773717 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:15.773625    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"
Sep 17 23:11:16.066164 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:16.066095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn"]
Sep 17 23:11:16.068298 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:11:16.068274    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5fb108_a3e1_4326_968f_d854ea5f38f0.slice/crio-190e93df347163b292ffe341a8342070bcbdc42b2c40cbbd97456f0cdd27eb9f WatchSource:0}: Error finding container 190e93df347163b292ffe341a8342070bcbdc42b2c40cbbd97456f0cdd27eb9f: Status 404 returned error can't find the container with id 190e93df347163b292ffe341a8342070bcbdc42b2c40cbbd97456f0cdd27eb9f
Sep 17 23:11:16.070155 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:16.070132    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:11:16.246058 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:16.246013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn" event={"ID":"3a5fb108-a3e1-4326-968f-d854ea5f38f0","Type":"ContainerStarted","Data":"190e93df347163b292ffe341a8342070bcbdc42b2c40cbbd97456f0cdd27eb9f"}
Sep 17 23:11:17.163678 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.163638    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:17.167300 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.167273    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.170321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.170230    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 23:11:17.170321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.170244    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 23:11:17.170321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.170271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 23:11:17.170585 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.170559    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zz26r\""
Sep 17 23:11:17.170846 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.170823    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 23:11:17.183947 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.183920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:17.187313 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187208    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vvfj\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.187817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.187693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.288936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.288820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.288936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.288896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.289260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.289211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vvfj\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.289340 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.289288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.289340 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.289315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.289438 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.289359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.289438 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.289410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.290146 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.290113    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.292059 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.292015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.292659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.292615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.292770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.292677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.292770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.292727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.299040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.299012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.299654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.299630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vvfj\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj\") pod \"istiod-openshift-gateway-7b7995d5cd-z6cj4\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:17.479624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:17.479544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:19.063420 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:19.063319    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:19.066831 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:11:19.066793    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab955a7_6e8a_4383_8aef_bc8f1210b56c.slice/crio-02b4d1c3e469893450c601bb86cbb170babdbc476f4be3f1cdce46f65e7952f9 WatchSource:0}: Error finding container 02b4d1c3e469893450c601bb86cbb170babdbc476f4be3f1cdce46f65e7952f9: Status 404 returned error can't find the container with id 02b4d1c3e469893450c601bb86cbb170babdbc476f4be3f1cdce46f65e7952f9
Sep 17 23:11:19.263957 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:19.263920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn" event={"ID":"3a5fb108-a3e1-4326-968f-d854ea5f38f0","Type":"ContainerStarted","Data":"45509722509bd3c41237ba2ecaa23f46aaa776c0343fc54e8fb683d3ef46bb3e"}
Sep 17 23:11:19.265210 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:19.265183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" event={"ID":"6ab955a7-6e8a-4383-8aef-bc8f1210b56c","Type":"ContainerStarted","Data":"02b4d1c3e469893450c601bb86cbb170babdbc476f4be3f1cdce46f65e7952f9"}
Sep 17 23:11:19.284714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:19.284665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55b8d65647-rj8qn" podStartSLOduration=1.504350402 podStartE2EDuration="4.284646292s" totalImagesPullingTime="2.78029589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:19.284188841 +0000 UTC m=+318.162704089" watchObservedRunningTime="2026-09-17 23:11:19.284646292 +0000 UTC m=+318.163161554"
Sep 17 23:11:21.848493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:21.848454    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:11:21.848860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:21.848542    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:11:22.282400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:22.282362    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" event={"ID":"6ab955a7-6e8a-4383-8aef-bc8f1210b56c","Type":"ContainerStarted","Data":"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"}
Sep 17 23:11:22.282574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:22.282457    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:22.284386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:22.284357    2581 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-z6cj4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:11:22.284510 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:22.284423    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:11:22.312235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:22.312178    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" podStartSLOduration=2.533199463 podStartE2EDuration="5.312159059s" totalImagesPullingTime="2.778959596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:22.3117683 +0000 UTC m=+321.190283546" watchObservedRunningTime="2026-09-17 23:11:22.312159059 +0000 UTC m=+321.190674306"
Sep 17 23:11:23.287927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:23.287897    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:35.763967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.763934    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"]
Sep 17 23:11:35.768871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.768846    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.771470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.771444    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 17 23:11:35.771599 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.771448    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cdlmc\""
Sep 17 23:11:35.778472 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.778449    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"]
Sep 17 23:11:35.782303 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.782280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"]
Sep 17 23:11:35.782398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.782380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.785587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.785566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 17 23:11:35.785753 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.785738    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-bwcnh\""
Sep 17 23:11:35.798007 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.797982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"]
Sep 17 23:11:35.845262 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.845220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86a199ad-6b4d-41ea-965a-e3c03443db9d-cert\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.845262 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.845271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdz95\" (UniqueName: \"kubernetes.io/projected/41579c73-5001-400e-9bf9-f05acd5d2890-kube-api-access-xdz95\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.845459 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.845297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41579c73-5001-400e-9bf9-f05acd5d2890-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.845459 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.845346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vclgj\" (UniqueName: \"kubernetes.io/projected/86a199ad-6b4d-41ea-965a-e3c03443db9d-kube-api-access-vclgj\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.946531 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.946493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdz95\" (UniqueName: \"kubernetes.io/projected/41579c73-5001-400e-9bf9-f05acd5d2890-kube-api-access-xdz95\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.946708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.946553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41579c73-5001-400e-9bf9-f05acd5d2890-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.946708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.946618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vclgj\" (UniqueName: \"kubernetes.io/projected/86a199ad-6b4d-41ea-965a-e3c03443db9d-kube-api-access-vclgj\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.946708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.946697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86a199ad-6b4d-41ea-965a-e3c03443db9d-cert\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.949209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.949174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/41579c73-5001-400e-9bf9-f05acd5d2890-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.949209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.949193    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86a199ad-6b4d-41ea-965a-e3c03443db9d-cert\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:35.955520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.955496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdz95\" (UniqueName: \"kubernetes.io/projected/41579c73-5001-400e-9bf9-f05acd5d2890-kube-api-access-xdz95\") pod \"llmisvc-controller-manager-777c6bd7d5-qkcbv\" (UID: \"41579c73-5001-400e-9bf9-f05acd5d2890\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:35.956231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:35.956209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vclgj\" (UniqueName: \"kubernetes.io/projected/86a199ad-6b4d-41ea-965a-e3c03443db9d-kube-api-access-vclgj\") pod \"kserve-controller-manager-d6f4b65b8-zgdh8\" (UID: \"86a199ad-6b4d-41ea-965a-e3c03443db9d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:36.083018 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:36.082924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:36.096139 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:36.096114    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:36.361346 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:36.361321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"]
Sep 17 23:11:36.363633 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:11:36.363607    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a199ad_6b4d_41ea_965a_e3c03443db9d.slice/crio-edbe41ae0b27b47687e951c65df3e70f57bd3b2ff3742f7460b14767f99e6517 WatchSource:0}: Error finding container edbe41ae0b27b47687e951c65df3e70f57bd3b2ff3742f7460b14767f99e6517: Status 404 returned error can't find the container with id edbe41ae0b27b47687e951c65df3e70f57bd3b2ff3742f7460b14767f99e6517
Sep 17 23:11:36.378914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:36.378890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"]
Sep 17 23:11:36.381975 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:11:36.381953    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod41579c73_5001_400e_9bf9_f05acd5d2890.slice/crio-98a2414754b42b5f768654d5ff089fbe859b2e37eadffefccea29e54b800b2b7 WatchSource:0}: Error finding container 98a2414754b42b5f768654d5ff089fbe859b2e37eadffefccea29e54b800b2b7: Status 404 returned error can't find the container with id 98a2414754b42b5f768654d5ff089fbe859b2e37eadffefccea29e54b800b2b7
Sep 17 23:11:37.353114 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:37.353079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8" event={"ID":"86a199ad-6b4d-41ea-965a-e3c03443db9d","Type":"ContainerStarted","Data":"edbe41ae0b27b47687e951c65df3e70f57bd3b2ff3742f7460b14767f99e6517"}
Sep 17 23:11:37.354748 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:37.354707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv" event={"ID":"41579c73-5001-400e-9bf9-f05acd5d2890","Type":"ContainerStarted","Data":"98a2414754b42b5f768654d5ff089fbe859b2e37eadffefccea29e54b800b2b7"}
Sep 17 23:11:39.367303 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.367258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8" event={"ID":"86a199ad-6b4d-41ea-965a-e3c03443db9d","Type":"ContainerStarted","Data":"bffacf92fca5b2584d12e9f39c4b80f8dbb5bd9008582721ca9a6bb4f45833b3"}
Sep 17 23:11:39.367743 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.367324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:11:39.368755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.368730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv" event={"ID":"41579c73-5001-400e-9bf9-f05acd5d2890","Type":"ContainerStarted","Data":"b6f0bda3b66069e079a4432f95d2a84af2eb6b29031a9762615f2e7897867f8a"}
Sep 17 23:11:39.368873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.368849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:11:39.416830 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.416784    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8" podStartSLOduration=1.644686885 podStartE2EDuration="4.416768476s" totalImagesPullingTime="2.772081591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:39.414769742 +0000 UTC m=+338.293284987" watchObservedRunningTime="2026-09-17 23:11:39.416768476 +0000 UTC m=+338.295283723"
Sep 17 23:11:39.437001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.436952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv" podStartSLOduration=1.677414008 podStartE2EDuration="4.436938838s" totalImagesPullingTime="2.75952483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:11:39.435245965 +0000 UTC m=+338.313761210" watchObservedRunningTime="2026-09-17 23:11:39.436938838 +0000 UTC m=+338.315454084"
Sep 17 23:11:39.515131 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.515095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:39.515297 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.515276    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerName="discovery" containerID="cri-o://fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97" gracePeriod=30
Sep 17 23:11:39.769672 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.769649    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:39.887580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vvfj\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887611    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887626    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887759    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.887803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.887786    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert\") pod \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\" (UID: \"6ab955a7-6e8a-4383-8aef-bc8f1210b56c\") "
Sep 17 23:11:39.888919 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.888878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:11:39.890236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890207    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs" (OuterVolumeSpecName: "local-certs") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:11:39.890350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts" (OuterVolumeSpecName: "cacerts") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:11:39.890410 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890377    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj" (OuterVolumeSpecName: "kube-api-access-5vvfj") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "kube-api-access-5vvfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:11:39.890410 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890399    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:11:39.890492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890406    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:11:39.890492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.890477    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6ab955a7-6e8a-4383-8aef-bc8f1210b56c" (UID: "6ab955a7-6e8a-4383-8aef-bc8f1210b56c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:11:39.988987 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988900    2581 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-cacerts\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.988987 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988933    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-ca-configmap\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.988987 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988947    2581 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-csr-dns-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.988987 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988969    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vvfj\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-kube-api-access-5vvfj\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.988987 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988981    2581 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-local-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.989269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.988993    2581 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-kubeconfig\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:39.989269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:39.989004    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ab955a7-6e8a-4383-8aef-bc8f1210b56c-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:11:40.374515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.374415    2581 generic.go:356] "Generic (PLEG): container finished" podID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerID="fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97" exitCode=0
Sep 17 23:11:40.374515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.374464    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"
Sep 17 23:11:40.375105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.374512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" event={"ID":"6ab955a7-6e8a-4383-8aef-bc8f1210b56c","Type":"ContainerDied","Data":"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"}
Sep 17 23:11:40.375105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.374606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4" event={"ID":"6ab955a7-6e8a-4383-8aef-bc8f1210b56c","Type":"ContainerDied","Data":"02b4d1c3e469893450c601bb86cbb170babdbc476f4be3f1cdce46f65e7952f9"}
Sep 17 23:11:40.375105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.374639    2581 scope.go:117] "RemoveContainer" containerID="fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"
Sep 17 23:11:40.384660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.384645    2581 scope.go:117] "RemoveContainer" containerID="fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"
Sep 17 23:11:40.384959 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:11:40.384935    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97\": container with ID starting with fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97 not found: ID does not exist" containerID="fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"
Sep 17 23:11:40.385034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.384968    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97"} err="failed to get container status \"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97\": rpc error: code = NotFound desc = could not find container \"fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97\": container with ID starting with fa92a757600859f77fc256aa329718865bf33c37d6ef99540d2c9f7f9c765f97 not found: ID does not exist"
Sep 17 23:11:40.396675 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.396651    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:40.399423 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:40.399392    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-z6cj4"]
Sep 17 23:11:41.660813 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:11:41.660772    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" path="/var/lib/kubelet/pods/6ab955a7-6e8a-4383-8aef-bc8f1210b56c/volumes"
Sep 17 23:12:10.377222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:10.377179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-qkcbv"
Sep 17 23:12:10.380301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:10.380280    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zgdh8"
Sep 17 23:12:43.386591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.386556    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"]
Sep 17 23:12:43.387000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.386927    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerName="discovery"
Sep 17 23:12:43.387000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.386938    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerName="discovery"
Sep 17 23:12:43.387000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.387000    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab955a7-6e8a-4383-8aef-bc8f1210b56c" containerName="discovery"
Sep 17 23:12:43.390124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.390107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:43.392603 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.392583    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 23:12:43.393543 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.393524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h2dnm\""
Sep 17 23:12:43.393620 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.393535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 23:12:43.398942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.398919    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"]
Sep 17 23:12:43.524233 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.524201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9hm\" (UniqueName: \"kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm\") pod \"limitador-operator-controller-manager-74495c69f8-4tmnv\" (UID: \"f578bd02-2d33-47bb-8ba0-d443d82751c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:43.625499 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.625456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9hm\" (UniqueName: \"kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm\") pod \"limitador-operator-controller-manager-74495c69f8-4tmnv\" (UID: \"f578bd02-2d33-47bb-8ba0-d443d82751c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:43.640998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.640928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9hm\" (UniqueName: \"kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm\") pod \"limitador-operator-controller-manager-74495c69f8-4tmnv\" (UID: \"f578bd02-2d33-47bb-8ba0-d443d82751c8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:43.699863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.699832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:43.970474 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:43.970442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"]
Sep 17 23:12:43.973350 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:12:43.973320    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf578bd02_2d33_47bb_8ba0_d443d82751c8.slice/crio-f1de9049bedd34facbb4afa89bfb33e8e622f72b720536aab249b086d47dd066 WatchSource:0}: Error finding container f1de9049bedd34facbb4afa89bfb33e8e622f72b720536aab249b086d47dd066: Status 404 returned error can't find the container with id f1de9049bedd34facbb4afa89bfb33e8e622f72b720536aab249b086d47dd066
Sep 17 23:12:44.666358 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:44.666319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv" event={"ID":"f578bd02-2d33-47bb-8ba0-d443d82751c8","Type":"ContainerStarted","Data":"f1de9049bedd34facbb4afa89bfb33e8e622f72b720536aab249b086d47dd066"}
Sep 17 23:12:47.510883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.510844    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"]
Sep 17 23:12:47.514272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.514252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.516971 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.516942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t687b\""
Sep 17 23:12:47.530061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.530014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"]
Sep 17 23:12:47.664985 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.664950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.665231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.665002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2cvw\" (UniqueName: \"kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.680653 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.680621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv" event={"ID":"f578bd02-2d33-47bb-8ba0-d443d82751c8","Type":"ContainerStarted","Data":"b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe"}
Sep 17 23:12:47.680826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.680738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:12:47.704370 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.704313    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv" podStartSLOduration=1.997072848 podStartE2EDuration="4.704296882s" totalImagesPullingTime="2.707224034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:12:47.703917231 +0000 UTC m=+406.582432476" watchObservedRunningTime="2026-09-17 23:12:47.704296882 +0000 UTC m=+406.582812129"
Sep 17 23:12:47.765673 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.765592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.765673 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.765630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2cvw\" (UniqueName: \"kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.765993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.765960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.774321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.774292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2cvw\" (UniqueName: \"kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:47.824715 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:47.824680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:48.102657 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:48.102408    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"]
Sep 17 23:12:48.105390 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:12:48.105363    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6113530_4932_4566_a379_df42764acaf0.slice/crio-31fdda5ae104fe3cdc2721499c12e6a10dbbb9b028f3278d440a6612a32d54e9 WatchSource:0}: Error finding container 31fdda5ae104fe3cdc2721499c12e6a10dbbb9b028f3278d440a6612a32d54e9: Status 404 returned error can't find the container with id 31fdda5ae104fe3cdc2721499c12e6a10dbbb9b028f3278d440a6612a32d54e9
Sep 17 23:12:48.687027 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:48.686983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd" event={"ID":"a6113530-4932-4566-a379-df42764acaf0","Type":"ContainerStarted","Data":"31fdda5ae104fe3cdc2721499c12e6a10dbbb9b028f3278d440a6612a32d54e9"}
Sep 17 23:12:50.330887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.330849    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-s5zrk"]
Sep 17 23:12:50.334371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.334350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:50.336811 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.336791    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wplsg\""
Sep 17 23:12:50.346191 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.346167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-s5zrk"]
Sep 17 23:12:50.490860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.490819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnv8q\" (UniqueName: \"kubernetes.io/projected/389d3610-b781-4197-a77e-feefa7c9de91-kube-api-access-bnv8q\") pod \"authorino-operator-76b478bd78-s5zrk\" (UID: \"389d3610-b781-4197-a77e-feefa7c9de91\") " pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:50.591582 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.591490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnv8q\" (UniqueName: \"kubernetes.io/projected/389d3610-b781-4197-a77e-feefa7c9de91-kube-api-access-bnv8q\") pod \"authorino-operator-76b478bd78-s5zrk\" (UID: \"389d3610-b781-4197-a77e-feefa7c9de91\") " pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:50.604852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.604798    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnv8q\" (UniqueName: \"kubernetes.io/projected/389d3610-b781-4197-a77e-feefa7c9de91-kube-api-access-bnv8q\") pod \"authorino-operator-76b478bd78-s5zrk\" (UID: \"389d3610-b781-4197-a77e-feefa7c9de91\") " pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:50.645553 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.645520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:50.942572 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:50.942544    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-s5zrk"]
Sep 17 23:12:50.945633 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:12:50.945509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod389d3610_b781_4197_a77e_feefa7c9de91.slice/crio-67f6c58d39e314f03dd1c7ae66349e5fb973d4b77ca6ffdf7896f468b4f595c8 WatchSource:0}: Error finding container 67f6c58d39e314f03dd1c7ae66349e5fb973d4b77ca6ffdf7896f468b4f595c8: Status 404 returned error can't find the container with id 67f6c58d39e314f03dd1c7ae66349e5fb973d4b77ca6ffdf7896f468b4f595c8
Sep 17 23:12:51.703999 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:51.703969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk" event={"ID":"389d3610-b781-4197-a77e-feefa7c9de91","Type":"ContainerStarted","Data":"67f6c58d39e314f03dd1c7ae66349e5fb973d4b77ca6ffdf7896f468b4f595c8"}
Sep 17 23:12:52.712092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:52.712040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd" event={"ID":"a6113530-4932-4566-a379-df42764acaf0","Type":"ContainerStarted","Data":"831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03"}
Sep 17 23:12:52.712526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:52.712215    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:12:52.753003 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:52.752949    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd" podStartSLOduration=1.348909734 podStartE2EDuration="5.752930782s" totalImagesPullingTime="4.404021048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:12:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:12:52.750316538 +0000 UTC m=+411.628831784" watchObservedRunningTime="2026-09-17 23:12:52.752930782 +0000 UTC m=+411.631446030"
Sep 17 23:12:53.718750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:53.718711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk" event={"ID":"389d3610-b781-4197-a77e-feefa7c9de91","Type":"ContainerStarted","Data":"f5a104c797807450e3a37a4fc191d3ce8fca493b1b5950305ca886bb4df7a561"}
Sep 17 23:12:53.719167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:53.718938    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:12:53.744592 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:53.744540    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk" podStartSLOduration=1.482033659 podStartE2EDuration="3.744522214s" totalImagesPullingTime="2.262488555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:12:53.743479972 +0000 UTC m=+412.621995217" watchObservedRunningTime="2026-09-17 23:12:53.744522214 +0000 UTC m=+412.623037461"
Sep 17 23:12:58.689478 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:12:58.689450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:03.721353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:03.721324    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:04.725970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:04.725935    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-s5zrk"
Sep 17 23:13:06.059137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.059102    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"]
Sep 17 23:13:06.059562 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.059356    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd" podUID="a6113530-4932-4566-a379-df42764acaf0" containerName="manager" containerID="cri-o://831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03" gracePeriod=2
Sep 17 23:13:06.072922 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.072898    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"]
Sep 17 23:13:06.082940 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.082900    2581 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a6113530-4932-4566-a379-df42764acaf0\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\": pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.085188 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.085166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"]
Sep 17 23:13:06.085542 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.085372    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" containerName="manager" containerID="cri-o://b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe" gracePeriod=2
Sep 17 23:13:06.088638 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.088594    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.091300 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.091278    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:06.091670 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.091654    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6113530-4932-4566-a379-df42764acaf0" containerName="manager"
Sep 17 23:13:06.091715 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.091673    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6113530-4932-4566-a379-df42764acaf0" containerName="manager"
Sep 17 23:13:06.091772 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.091761    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6113530-4932-4566-a379-df42764acaf0" containerName="manager"
Sep 17 23:13:06.096311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.096292    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.098257 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.098233    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"]
Sep 17 23:13:06.098754 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.098727    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.111881 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.111860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:06.113418 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.113398    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"]
Sep 17 23:13:06.113759 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.113744    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" containerName="manager"
Sep 17 23:13:06.113824 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.113763    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" containerName="manager"
Sep 17 23:13:06.113879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.113871    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" containerName="manager"
Sep 17 23:13:06.117450 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.117435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:06.120866 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.120846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.121006 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.120986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xncr\" (UniqueName: \"kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.127696 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.127669    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.129684 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.129646    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.138668 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.138642    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"]
Sep 17 23:13:06.156663 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.156634    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.222271 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.222237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xncr\" (UniqueName: \"kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.222451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.222286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4fk\" (UniqueName: \"kubernetes.io/projected/230f8556-1fa7-45fc-88d5-02890c8861f8-kube-api-access-cv4fk\") pod \"limitador-operator-controller-manager-74495c69f8-hb98l\" (UID: \"230f8556-1fa7-45fc-88d5-02890c8861f8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:06.222451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.222409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.222743 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.222723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.231465 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.231431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xncr\" (UniqueName: \"kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr\") pod \"kuadrant-operator-controller-manager-76f8f686bf-82447\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.322927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.322903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4fk\" (UniqueName: \"kubernetes.io/projected/230f8556-1fa7-45fc-88d5-02890c8861f8-kube-api-access-cv4fk\") pod \"limitador-operator-controller-manager-74495c69f8-hb98l\" (UID: \"230f8556-1fa7-45fc-88d5-02890c8861f8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:06.327450 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.327427    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.329738 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.329721    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.330330 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.330309    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.332381 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.332360    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.334565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.334550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4fk\" (UniqueName: \"kubernetes.io/projected/230f8556-1fa7-45fc-88d5-02890c8861f8-kube-api-access-cv4fk\") pod \"limitador-operator-controller-manager-74495c69f8-hb98l\" (UID: \"230f8556-1fa7-45fc-88d5-02890c8861f8\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:06.335944 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.335925    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.338086 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.338068    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.423487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.423460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq9hm\" (UniqueName: \"kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm\") pod \"f578bd02-2d33-47bb-8ba0-d443d82751c8\" (UID: \"f578bd02-2d33-47bb-8ba0-d443d82751c8\") "
Sep 17 23:13:06.423630 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.423492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2cvw\" (UniqueName: \"kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw\") pod \"a6113530-4932-4566-a379-df42764acaf0\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") "
Sep 17 23:13:06.423630 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.423569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume\") pod \"a6113530-4932-4566-a379-df42764acaf0\" (UID: \"a6113530-4932-4566-a379-df42764acaf0\") "
Sep 17 23:13:06.423969 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.423942    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a6113530-4932-4566-a379-df42764acaf0" (UID: "a6113530-4932-4566-a379-df42764acaf0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:13:06.425726 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.425702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw" (OuterVolumeSpecName: "kube-api-access-p2cvw") pod "a6113530-4932-4566-a379-df42764acaf0" (UID: "a6113530-4932-4566-a379-df42764acaf0"). InnerVolumeSpecName "kube-api-access-p2cvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:13:06.425726 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.425715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm" (OuterVolumeSpecName: "kube-api-access-jq9hm") pod "f578bd02-2d33-47bb-8ba0-d443d82751c8" (UID: "f578bd02-2d33-47bb-8ba0-d443d82751c8"). InnerVolumeSpecName "kube-api-access-jq9hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:13:06.498002 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.497972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:06.503362 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.503345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:06.525299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.525258    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6113530-4932-4566-a379-df42764acaf0-extensions-socket-volume\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:06.525398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.525306    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq9hm\" (UniqueName: \"kubernetes.io/projected/f578bd02-2d33-47bb-8ba0-d443d82751c8-kube-api-access-jq9hm\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:06.525398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.525327    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2cvw\" (UniqueName: \"kubernetes.io/projected/a6113530-4932-4566-a379-df42764acaf0-kube-api-access-p2cvw\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:06.780605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.780568    2581 generic.go:356] "Generic (PLEG): container finished" podID="a6113530-4932-4566-a379-df42764acaf0" containerID="831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03" exitCode=0
Sep 17 23:13:06.780760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.780630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.780760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.780660    2581 scope.go:117] "RemoveContainer" containerID="831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03"
Sep 17 23:13:06.782341 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.782313    2581 generic.go:356] "Generic (PLEG): container finished" podID="f578bd02-2d33-47bb-8ba0-d443d82751c8" containerID="b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe" exitCode=0
Sep 17 23:13:06.782481 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.782374    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.783667 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.783628    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.786621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.786551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"]
Sep 17 23:13:06.786771 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.786743    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.789073 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.789002    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.789264 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:13:06.789241    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230f8556_1fa7_45fc_88d5_02890c8861f8.slice/crio-d5afba00c451f2bda56a3aa985484796fc3b29120a6b541610919ce3c9c0cf3c WatchSource:0}: Error finding container d5afba00c451f2bda56a3aa985484796fc3b29120a6b541610919ce3c9c0cf3c: Status 404 returned error can't find the container with id d5afba00c451f2bda56a3aa985484796fc3b29120a6b541610919ce3c9c0cf3c
Sep 17 23:13:06.792478 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.792361    2581 scope.go:117] "RemoveContainer" containerID="831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03"
Sep 17 23:13:06.792741 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.792645    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.792741 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.792721    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03\": container with ID starting with 831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03 not found: ID does not exist" containerID="831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03"
Sep 17 23:13:06.792854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.792763    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03"} err="failed to get container status \"831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03\": rpc error: code = NotFound desc = could not find container \"831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03\": container with ID starting with 831cd91ca2dfc84669a6d14371bf93278eb5d4214e3197fcf37cbb45b93b9c03 not found: ID does not exist"
Sep 17 23:13:06.792854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.792782    2581 scope.go:117] "RemoveContainer" containerID="b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe"
Sep 17 23:13:06.794129 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:13:06.794105    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47da24d7_b4fd_4cc7_88f6_b7046c8f922b.slice/crio-83b6bc945e7868720fd1f4082c926a774111cc249eadf50c6b7a27a7d8eca178 WatchSource:0}: Error finding container 83b6bc945e7868720fd1f4082c926a774111cc249eadf50c6b7a27a7d8eca178: Status 404 returned error can't find the container with id 83b6bc945e7868720fd1f4082c926a774111cc249eadf50c6b7a27a7d8eca178
Sep 17 23:13:06.797349 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.797331    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:06.798126 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.798095    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.800153 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.800128    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:06.801674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.801627    2581 scope.go:117] "RemoveContainer" containerID="b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe"
Sep 17 23:13:06.801922 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.801898    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe\": container with ID starting with b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe not found: ID does not exist" containerID="b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe"
Sep 17 23:13:06.802011 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:06.801929    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe"} err="failed to get container status \"b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe\": rpc error: code = NotFound desc = could not find container \"b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe\": container with ID starting with b3c9558c12f6777a2d274b1ff9763be1255ad7be88e8cfcc356610ce81d4fcbe not found: ID does not exist"
Sep 17 23:13:06.802257 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.802232    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4tmnv\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4tmnv"
Sep 17 23:13:06.804308 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:06.804287    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9kwd\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a6113530-4932-4566-a379-df42764acaf0" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9kwd"
Sep 17 23:13:07.660852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.660821    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6113530-4932-4566-a379-df42764acaf0" path="/var/lib/kubelet/pods/a6113530-4932-4566-a379-df42764acaf0/volumes"
Sep 17 23:13:07.661225 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.661150    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f578bd02-2d33-47bb-8ba0-d443d82751c8" path="/var/lib/kubelet/pods/f578bd02-2d33-47bb-8ba0-d443d82751c8/volumes"
Sep 17 23:13:07.791277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.791244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l" event={"ID":"230f8556-1fa7-45fc-88d5-02890c8861f8","Type":"ContainerStarted","Data":"d17fbe2bcd9c60a7e04e25661958dc813795a63292ea2d2e33a022babec4e9f7"}
Sep 17 23:13:07.791458 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.791302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l" event={"ID":"230f8556-1fa7-45fc-88d5-02890c8861f8","Type":"ContainerStarted","Data":"d5afba00c451f2bda56a3aa985484796fc3b29120a6b541610919ce3c9c0cf3c"}
Sep 17 23:13:07.791458 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.791351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:07.793106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.793078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" event={"ID":"47da24d7-b4fd-4cc7-88f6-b7046c8f922b","Type":"ContainerStarted","Data":"a5189123ab13c9b01889bec9f8e29e2c10cb4f4191197a44703248b7cc3e74fe"}
Sep 17 23:13:07.793246 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.793119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" event={"ID":"47da24d7-b4fd-4cc7-88f6-b7046c8f922b","Type":"ContainerStarted","Data":"83b6bc945e7868720fd1f4082c926a774111cc249eadf50c6b7a27a7d8eca178"}
Sep 17 23:13:07.793246 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.793149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:07.820334 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.820292    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l" podStartSLOduration=1.82027551 podStartE2EDuration="1.82027551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:13:07.819407873 +0000 UTC m=+426.697923161" watchObservedRunningTime="2026-09-17 23:13:07.82027551 +0000 UTC m=+426.698790755"
Sep 17 23:13:07.871065 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:07.871001    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" podStartSLOduration=1.870980847 podStartE2EDuration="1.870980847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:13:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:13:07.870419003 +0000 UTC m=+426.748934253" watchObservedRunningTime="2026-09-17 23:13:07.870980847 +0000 UTC m=+426.749496094"
Sep 17 23:13:18.800782 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:18.800747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hb98l"
Sep 17 23:13:18.801323 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:18.800906    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:23.077190 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.077149    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:23.077583 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.077421    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" podUID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" containerName="manager" containerID="cri-o://a5189123ab13c9b01889bec9f8e29e2c10cb4f4191197a44703248b7cc3e74fe" gracePeriod=10
Sep 17 23:13:23.876779 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.876744    2581 generic.go:356] "Generic (PLEG): container finished" podID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" containerID="a5189123ab13c9b01889bec9f8e29e2c10cb4f4191197a44703248b7cc3e74fe" exitCode=0
Sep 17 23:13:23.876936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.876817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" event={"ID":"47da24d7-b4fd-4cc7-88f6-b7046c8f922b","Type":"ContainerDied","Data":"a5189123ab13c9b01889bec9f8e29e2c10cb4f4191197a44703248b7cc3e74fe"}
Sep 17 23:13:23.920750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.920725    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:23.970821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.970743    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume\") pod \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") "
Sep 17 23:13:23.970821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.970788    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xncr\" (UniqueName: \"kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr\") pod \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\" (UID: \"47da24d7-b4fd-4cc7-88f6-b7046c8f922b\") "
Sep 17 23:13:23.971139 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.971118    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "47da24d7-b4fd-4cc7-88f6-b7046c8f922b" (UID: "47da24d7-b4fd-4cc7-88f6-b7046c8f922b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:13:23.972931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:23.972900    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr" (OuterVolumeSpecName: "kube-api-access-9xncr") pod "47da24d7-b4fd-4cc7-88f6-b7046c8f922b" (UID: "47da24d7-b4fd-4cc7-88f6-b7046c8f922b"). InnerVolumeSpecName "kube-api-access-9xncr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:13:24.072383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.072292    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-extensions-socket-volume\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:24.072383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.072327    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xncr\" (UniqueName: \"kubernetes.io/projected/47da24d7-b4fd-4cc7-88f6-b7046c8f922b-kube-api-access-9xncr\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:24.882954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.882924    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"
Sep 17 23:13:24.883429 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.882927    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447" event={"ID":"47da24d7-b4fd-4cc7-88f6-b7046c8f922b","Type":"ContainerDied","Data":"83b6bc945e7868720fd1f4082c926a774111cc249eadf50c6b7a27a7d8eca178"}
Sep 17 23:13:24.883429 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.883076    2581 scope.go:117] "RemoveContainer" containerID="a5189123ab13c9b01889bec9f8e29e2c10cb4f4191197a44703248b7cc3e74fe"
Sep 17 23:13:24.904943 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.904913    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:24.908952 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:24.908923    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-82447"]
Sep 17 23:13:25.659874 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:25.659841    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" path="/var/lib/kubelet/pods/47da24d7-b4fd-4cc7-88f6-b7046c8f922b/volumes"
Sep 17 23:13:44.846606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.846565    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:44.847128 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.847110    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" containerName="manager"
Sep 17 23:13:44.847128 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.847130    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" containerName="manager"
Sep 17 23:13:44.847282 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.847242    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47da24d7-b4fd-4cc7-88f6-b7046c8f922b" containerName="manager"
Sep 17 23:13:44.851336 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.851314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:44.853617 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.853598    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rdj4p\""
Sep 17 23:13:44.853937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.853920    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 23:13:44.861926 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.861903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:44.942177 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.942138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:44.942369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.942191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlth\" (UniqueName: \"kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:44.956171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:44.956139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:45.043467 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.043424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:45.043634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.043473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlth\" (UniqueName: \"kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:45.044088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.044039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:45.057390 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.057361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlth\" (UniqueName: \"kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth\") pod \"limitador-limitador-8588749977-x2b6p\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") " pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:45.161615 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.161578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:45.280556 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.280522    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:13:45.284352 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.284335    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.300580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.300557    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:13:45.328484 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.328456    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:13:45.347078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.347014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcxmt\" (UniqueName: \"kubernetes.io/projected/729bf33e-0012-401f-895d-d14318e1fb81-kube-api-access-rcxmt\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.347180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.347078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/729bf33e-0012-401f-895d-d14318e1fb81-config-file\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.432307 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.432267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:45.434454 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:13:45.434424    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d3a1a4_b17e_4732_935c_817aa994d8ea.slice/crio-2ac8b463ab5a9658aeca40957693a53d4288cdc3ac7fcd62d59814c3d201f95e WatchSource:0}: Error finding container 2ac8b463ab5a9658aeca40957693a53d4288cdc3ac7fcd62d59814c3d201f95e: Status 404 returned error can't find the container with id 2ac8b463ab5a9658aeca40957693a53d4288cdc3ac7fcd62d59814c3d201f95e
Sep 17 23:13:45.447848 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.447825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcxmt\" (UniqueName: \"kubernetes.io/projected/729bf33e-0012-401f-895d-d14318e1fb81-kube-api-access-rcxmt\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.447942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.447858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/729bf33e-0012-401f-895d-d14318e1fb81-config-file\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.448449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.448430    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/729bf33e-0012-401f-895d-d14318e1fb81-config-file\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.455847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.455829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcxmt\" (UniqueName: \"kubernetes.io/projected/729bf33e-0012-401f-895d-d14318e1fb81-kube-api-access-rcxmt\") pod \"limitador-limitador-84994f7ffc-5j6tz\" (UID: \"729bf33e-0012-401f-895d-d14318e1fb81\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.594291 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.594259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:45.875126 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.875102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:13:45.877501 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:13:45.877473    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729bf33e_0012_401f_895d_d14318e1fb81.slice/crio-7c2ecdbc5c731598f31a2b9f2a4dae01ce551068484a2905af4a8ff44120c7a1 WatchSource:0}: Error finding container 7c2ecdbc5c731598f31a2b9f2a4dae01ce551068484a2905af4a8ff44120c7a1: Status 404 returned error can't find the container with id 7c2ecdbc5c731598f31a2b9f2a4dae01ce551068484a2905af4a8ff44120c7a1
Sep 17 23:13:45.986459 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.986427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz" event={"ID":"729bf33e-0012-401f-895d-d14318e1fb81","Type":"ContainerStarted","Data":"7c2ecdbc5c731598f31a2b9f2a4dae01ce551068484a2905af4a8ff44120c7a1"}
Sep 17 23:13:45.987606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:45.987581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" event={"ID":"23d3a1a4-b17e-4732-935c-817aa994d8ea","Type":"ContainerStarted","Data":"2ac8b463ab5a9658aeca40957693a53d4288cdc3ac7fcd62d59814c3d201f95e"}
Sep 17 23:13:46.993992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:46.993954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz" event={"ID":"729bf33e-0012-401f-895d-d14318e1fb81","Type":"ContainerStarted","Data":"b70637c7acd62ed4a43b99170cac75b6fdee1856884c8f57e1442a2427bc75d0"}
Sep 17 23:13:46.994431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:46.994017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:46.995588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:46.995559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" event={"ID":"23d3a1a4-b17e-4732-935c-817aa994d8ea","Type":"ContainerStarted","Data":"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"}
Sep 17 23:13:46.995689 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:46.995616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:47.010427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:47.010378    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz" podStartSLOduration=1.319568334 podStartE2EDuration="2.010357303s" totalImagesPullingTime="690.788969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:13:47.009683291 +0000 UTC m=+465.888198537" watchObservedRunningTime="2026-09-17 23:13:47.010357303 +0000 UTC m=+465.888872578"
Sep 17 23:13:47.031744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:47.031705    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" podStartSLOduration=1.899648848 podStartE2EDuration="3.03169338s" totalImagesPullingTime="1.132044532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:13:47.030823101 +0000 UTC m=+465.909338347" watchObservedRunningTime="2026-09-17 23:13:47.03169338 +0000 UTC m=+465.910208626"
Sep 17 23:13:58.001546 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.001509    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:58.002006 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.001581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"
Sep 17 23:13:58.059473 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.059438    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:58.059643 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.059608    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" podUID="23d3a1a4-b17e-4732-935c-817aa994d8ea" containerName="limitador" containerID="cri-o://c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735" gracePeriod=30
Sep 17 23:13:58.606914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.606890    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:58.760277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.760243    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file\") pod \"23d3a1a4-b17e-4732-935c-817aa994d8ea\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") "
Sep 17 23:13:58.760444 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.760341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hlth\" (UniqueName: \"kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth\") pod \"23d3a1a4-b17e-4732-935c-817aa994d8ea\" (UID: \"23d3a1a4-b17e-4732-935c-817aa994d8ea\") "
Sep 17 23:13:58.760689 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.760663    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file" (OuterVolumeSpecName: "config-file") pod "23d3a1a4-b17e-4732-935c-817aa994d8ea" (UID: "23d3a1a4-b17e-4732-935c-817aa994d8ea"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:13:58.762389 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.762369    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth" (OuterVolumeSpecName: "kube-api-access-2hlth") pod "23d3a1a4-b17e-4732-935c-817aa994d8ea" (UID: "23d3a1a4-b17e-4732-935c-817aa994d8ea"). InnerVolumeSpecName "kube-api-access-2hlth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:13:58.860974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.860931    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hlth\" (UniqueName: \"kubernetes.io/projected/23d3a1a4-b17e-4732-935c-817aa994d8ea-kube-api-access-2hlth\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:58.860974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:58.860969    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/23d3a1a4-b17e-4732-935c-817aa994d8ea-config-file\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:13:59.054764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.054678    2581 generic.go:356] "Generic (PLEG): container finished" podID="23d3a1a4-b17e-4732-935c-817aa994d8ea" containerID="c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735" exitCode=0
Sep 17 23:13:59.054764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.054722    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p"
Sep 17 23:13:59.055220 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.054763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" event={"ID":"23d3a1a4-b17e-4732-935c-817aa994d8ea","Type":"ContainerDied","Data":"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"}
Sep 17 23:13:59.055220 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.054810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-x2b6p" event={"ID":"23d3a1a4-b17e-4732-935c-817aa994d8ea","Type":"ContainerDied","Data":"2ac8b463ab5a9658aeca40957693a53d4288cdc3ac7fcd62d59814c3d201f95e"}
Sep 17 23:13:59.055220 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.054836    2581 scope.go:117] "RemoveContainer" containerID="c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"
Sep 17 23:13:59.063493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.063279    2581 scope.go:117] "RemoveContainer" containerID="c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"
Sep 17 23:13:59.063571 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:13:59.063553    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735\": container with ID starting with c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735 not found: ID does not exist" containerID="c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"
Sep 17 23:13:59.063612 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.063580    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735"} err="failed to get container status \"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735\": rpc error: code = NotFound desc = could not find container \"c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735\": container with ID starting with c18b051dfec701effec72fa92f720f20ef0c4655834963841de796d07c8b7735 not found: ID does not exist"
Sep 17 23:13:59.074558 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.074530    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:59.078961 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.078940    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-x2b6p"]
Sep 17 23:13:59.660678 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:13:59.660643    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d3a1a4-b17e-4732-935c-817aa994d8ea" path="/var/lib/kubelet/pods/23d3a1a4-b17e-4732-935c-817aa994d8ea/volumes"
Sep 17 23:14:03.778606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.778573    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f728k"]
Sep 17 23:14:03.778959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.778917    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d3a1a4-b17e-4732-935c-817aa994d8ea" containerName="limitador"
Sep 17 23:14:03.778959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.778929    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d3a1a4-b17e-4732-935c-817aa994d8ea" containerName="limitador"
Sep 17 23:14:03.779030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.778998    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d3a1a4-b17e-4732-935c-817aa994d8ea" containerName="limitador"
Sep 17 23:14:03.783346 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.783328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:03.786200 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.786155    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 23:14:03.786200 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.786187    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 23:14:03.786363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.786277    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 23:14:03.787008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.786995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nqm8r\""
Sep 17 23:14:03.791350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.791331    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f728k"]
Sep 17 23:14:03.902643 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.902603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a12f247e-7314-49a2-9227-9148c6eb8a87-data\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:03.902811 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:03.902743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc2fg\" (UniqueName: \"kubernetes.io/projected/a12f247e-7314-49a2-9227-9148c6eb8a87-kube-api-access-mc2fg\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.003349 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.003312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc2fg\" (UniqueName: \"kubernetes.io/projected/a12f247e-7314-49a2-9227-9148c6eb8a87-kube-api-access-mc2fg\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.003349 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.003355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a12f247e-7314-49a2-9227-9148c6eb8a87-data\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.003724 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.003707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a12f247e-7314-49a2-9227-9148c6eb8a87-data\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.011591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.011568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc2fg\" (UniqueName: \"kubernetes.io/projected/a12f247e-7314-49a2-9227-9148c6eb8a87-kube-api-access-mc2fg\") pod \"postgres-69fb4594cf-f728k\" (UID: \"a12f247e-7314-49a2-9227-9148c6eb8a87\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.093532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.093455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:04.368232 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:04.368206    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-f728k"]
Sep 17 23:14:04.370690 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:14:04.370658    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12f247e_7314_49a2_9227_9148c6eb8a87.slice/crio-c37e2a0f1977c5205a1b649776aee73cecf254b5b43d6f18da62467f514b0f47 WatchSource:0}: Error finding container c37e2a0f1977c5205a1b649776aee73cecf254b5b43d6f18da62467f514b0f47: Status 404 returned error can't find the container with id c37e2a0f1977c5205a1b649776aee73cecf254b5b43d6f18da62467f514b0f47
Sep 17 23:14:05.087036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:05.086944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k" event={"ID":"a12f247e-7314-49a2-9227-9148c6eb8a87","Type":"ContainerStarted","Data":"c37e2a0f1977c5205a1b649776aee73cecf254b5b43d6f18da62467f514b0f47"}
Sep 17 23:14:09.109478 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:09.109441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k" event={"ID":"a12f247e-7314-49a2-9227-9148c6eb8a87","Type":"ContainerStarted","Data":"1b929e9d41baec085821ad1d10b8cee03c19029512346d4cf29dfdda821208f8"}
Sep 17 23:14:09.109901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:09.109563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:09.125296 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:09.125252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k" podStartSLOduration=1.5032408 podStartE2EDuration="6.125236212s" totalImagesPullingTime="4.621995412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:14:09.123343339 +0000 UTC m=+488.001858585" watchObservedRunningTime="2026-09-17 23:14:09.125236212 +0000 UTC m=+488.003751458"
Sep 17 23:14:15.142541 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:15.142508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-f728k"
Sep 17 23:14:55.593730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.593643    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:14:55.597117 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.597096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.599272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.599245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 23:14:55.599272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.599268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 23:14:55.608999 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.608975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:14:55.742293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.742252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.742487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.742375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4drw\" (UniqueName: \"kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.742575 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.742550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.742747 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.742709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.843622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.843582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4drw\" (UniqueName: \"kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.843845 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.843634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.843845 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.843662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.843845 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.843684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.844411 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.844384    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.846162 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.846141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.846240 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.846188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.854073 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.853904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4drw\" (UniqueName: \"kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw\") pod \"maas-api-7bb7f9d9f-995q4\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") " pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:55.908013 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:55.907981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:56.182992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:56.182967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:14:56.185985 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:14:56.185944    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529b16a2_c90e_4a75_b633_96403d3e0935.slice/crio-65db077b6e2d040f2aa91eb7f32d09bb6597d17a24ebe573206da755861f78a4 WatchSource:0}: Error finding container 65db077b6e2d040f2aa91eb7f32d09bb6597d17a24ebe573206da755861f78a4: Status 404 returned error can't find the container with id 65db077b6e2d040f2aa91eb7f32d09bb6597d17a24ebe573206da755861f78a4
Sep 17 23:14:56.331451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:56.331408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" event={"ID":"529b16a2-c90e-4a75-b633-96403d3e0935","Type":"ContainerStarted","Data":"65db077b6e2d040f2aa91eb7f32d09bb6597d17a24ebe573206da755861f78a4"}
Sep 17 23:14:56.342467 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:56.342439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:14:59.348270 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:59.348226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" event={"ID":"529b16a2-c90e-4a75-b633-96403d3e0935","Type":"ContainerStarted","Data":"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"}
Sep 17 23:14:59.348659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:59.348297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:14:59.365848 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:14:59.365795    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" podStartSLOduration=2.028527965 podStartE2EDuration="4.365781895s" totalImagesPullingTime="2.33725393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:14:59.363536007 +0000 UTC m=+538.242051255" watchObservedRunningTime="2026-09-17 23:14:59.365781895 +0000 UTC m=+538.244297141"
Sep 17 23:15:05.359210 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:05.359178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:15:25.043514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.043482    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"]
Sep 17 23:15:25.048101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.048085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.050394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.050370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 23:15:25.051226 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.051205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-frvp9\""
Sep 17 23:15:25.051339 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.051294    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 23:15:25.051402 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.051341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 17 23:15:25.056536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.056505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"]
Sep 17 23:15:25.069789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.069907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.069907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2b025a-e0e4-4600-8504-e73914d5bd92-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.069907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.070092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2bgm\" (UniqueName: \"kubernetes.io/projected/3c2b025a-e0e4-4600-8504-e73914d5bd92-kube-api-access-l2bgm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.070092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.069949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.170849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.170820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.170862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.170884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.170962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2b025a-e0e4-4600-8504-e73914d5bd92-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.171000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171300 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.171033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2bgm\" (UniqueName: \"kubernetes.io/projected/3c2b025a-e0e4-4600-8504-e73914d5bd92-kube-api-access-l2bgm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171300 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.171253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171404 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.171325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.171464 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.171397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.173146 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.173127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c2b025a-e0e4-4600-8504-e73914d5bd92-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.173354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.173336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c2b025a-e0e4-4600-8504-e73914d5bd92-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.178060 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.178027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2bgm\" (UniqueName: \"kubernetes.io/projected/3c2b025a-e0e4-4600-8504-e73914d5bd92-kube-api-access-l2bgm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4\" (UID: \"3c2b025a-e0e4-4600-8504-e73914d5bd92\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.359476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.359390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:25.632652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.632577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"]
Sep 17 23:15:25.635469 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:25.635443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:15:25.636339 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:15:25.636317    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2b025a_e0e4_4600_8504_e73914d5bd92.slice/crio-06abd5a1cdc298b0f2e19f0a0cc399c138735adf32c77d1472c87f93008710f8 WatchSource:0}: Error finding container 06abd5a1cdc298b0f2e19f0a0cc399c138735adf32c77d1472c87f93008710f8: Status 404 returned error can't find the container with id 06abd5a1cdc298b0f2e19f0a0cc399c138735adf32c77d1472c87f93008710f8
Sep 17 23:15:26.472277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:26.472228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4" event={"ID":"3c2b025a-e0e4-4600-8504-e73914d5bd92","Type":"ContainerStarted","Data":"06abd5a1cdc298b0f2e19f0a0cc399c138735adf32c77d1472c87f93008710f8"}
Sep 17 23:15:27.478604 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:27.478571    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4" event={"ID":"3c2b025a-e0e4-4600-8504-e73914d5bd92","Type":"ContainerStarted","Data":"a3ec73630c3546c5dbd6bc7a0dad321f8d2735ba4aa1f4c5eabbf7570ea1336e"}
Sep 17 23:15:27.498457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:27.498411    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4" podStartSLOduration=1.4057806560000001 podStartE2EDuration="2.498393828s" totalImagesPullingTime="1.092613172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:15:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:15:27.497991266 +0000 UTC m=+566.376506512" watchObservedRunningTime="2026-09-17 23:15:27.498393828 +0000 UTC m=+566.376909075"
Sep 17 23:15:35.332574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:35.332536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:15:35.360142 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:35.360111    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:35.360389 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:35.360369    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:35.373141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:35.373118    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:35.526456 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:35.526423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4"
Sep 17 23:15:39.332980 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:39.332945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:15:49.435481 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.435441    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"]
Sep 17 23:15:49.442400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.442377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.444670 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.444650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 17 23:15:49.450160 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.450138    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"]
Sep 17 23:15:49.576443 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.576609 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.576609 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.576609 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.576733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9qzc\" (UniqueName: \"kubernetes.io/projected/0f7c07b7-3243-4637-9c53-3c75ef6af08e-kube-api-access-f9qzc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.576733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.576680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677682 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677682 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9qzc\" (UniqueName: \"kubernetes.io/projected/0f7c07b7-3243-4637-9c53-3c75ef6af08e-kube-api-access-f9qzc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.677916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.677797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.678168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.678111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.678168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.678137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.678260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.678198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.680083 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.680059    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f7c07b7-3243-4637-9c53-3c75ef6af08e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.680311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.680296    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f7c07b7-3243-4637-9c53-3c75ef6af08e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.685344 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.685324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9qzc\" (UniqueName: \"kubernetes.io/projected/0f7c07b7-3243-4637-9c53-3c75ef6af08e-kube-api-access-f9qzc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-grtvh\" (UID: \"0f7c07b7-3243-4637-9c53-3c75ef6af08e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:49.753884 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:49.753806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:50.029832 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:50.029713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"]
Sep 17 23:15:50.032397 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:15:50.032370    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7c07b7_3243_4637_9c53_3c75ef6af08e.slice/crio-2e3f8016149932b06f4bc0961728f20c28e451d2ac8a8e7bbe2e6c25efe9939a WatchSource:0}: Error finding container 2e3f8016149932b06f4bc0961728f20c28e451d2ac8a8e7bbe2e6c25efe9939a: Status 404 returned error can't find the container with id 2e3f8016149932b06f4bc0961728f20c28e451d2ac8a8e7bbe2e6c25efe9939a
Sep 17 23:15:50.586903 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:50.586867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh" event={"ID":"0f7c07b7-3243-4637-9c53-3c75ef6af08e","Type":"ContainerStarted","Data":"a88977152c1410b792fec1da1006a263d52ecafa90839880262b88d36194c5e7"}
Sep 17 23:15:50.587393 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:50.586963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh" event={"ID":"0f7c07b7-3243-4637-9c53-3c75ef6af08e","Type":"ContainerStarted","Data":"2e3f8016149932b06f4bc0961728f20c28e451d2ac8a8e7bbe2e6c25efe9939a"}
Sep 17 23:15:50.610359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:50.610310    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh" podStartSLOduration=1.432326728 podStartE2EDuration="1.610294234s" totalImagesPullingTime="177.967506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:15:50.608669959 +0000 UTC m=+589.487185205" watchObservedRunningTime="2026-09-17 23:15:50.610294234 +0000 UTC m=+589.488809535"
Sep 17 23:15:50.838854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:50.838776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:15:59.754126 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:59.754076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:59.754126 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:59.754148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:15:59.766826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:15:59.766798    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:16:00.642241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:00.642213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-grtvh"
Sep 17 23:16:01.579955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:01.579927    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:16:01.581895 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:01.581870    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:16:05.538391 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:05.538355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:16:17.337517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:17.337476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:16:24.437927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:16:24.437840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:17:41.247851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.247820    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:17:41.338328 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.338290    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7647-f6046a"]
Sep 17 23:17:41.341842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.341823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:41.344147 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.344120    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8nhtg\""
Sep 17 23:17:41.346145 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.346118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7647-f6046a"]
Sep 17 23:17:41.443228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.443190    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng9lc\" (UniqueName: \"kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc\") pod \"test-curl-7647-f6046a\" (UID: \"84dfae5c-8618-4325-a0d7-3ea498cd0bde\") " pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:41.544622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.544542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng9lc\" (UniqueName: \"kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc\") pod \"test-curl-7647-f6046a\" (UID: \"84dfae5c-8618-4325-a0d7-3ea498cd0bde\") " pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:41.552413 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.552382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng9lc\" (UniqueName: \"kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc\") pod \"test-curl-7647-f6046a\" (UID: \"84dfae5c-8618-4325-a0d7-3ea498cd0bde\") " pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:41.652151 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.652118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:41.926879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.926833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7647-f6046a"]
Sep 17 23:17:41.933405 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:41.933377    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84dfae5c_8618_4325_a0d7_3ea498cd0bde.slice/crio-578a6829c6ce440fc47c1746cefceefb2e5cca35bcbd3a0d29996756f903f5c2 WatchSource:0}: Error finding container 578a6829c6ce440fc47c1746cefceefb2e5cca35bcbd3a0d29996756f903f5c2: Status 404 returned error can't find the container with id 578a6829c6ce440fc47c1746cefceefb2e5cca35bcbd3a0d29996756f903f5c2
Sep 17 23:17:41.935246 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:41.935227    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:17:42.115299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:42.115258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7647-f6046a" event={"ID":"84dfae5c-8618-4325-a0d7-3ea498cd0bde","Type":"ContainerStarted","Data":"578a6829c6ce440fc47c1746cefceefb2e5cca35bcbd3a0d29996756f903f5c2"}
Sep 17 23:17:43.644713 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.644431    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:17:43.656368 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.656338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.659705 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.659659    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-7ab633-serving-cert\""
Sep 17 23:17:43.659863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.659734    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xltjn\""
Sep 17 23:17:43.665365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.665341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:17:43.765008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.764971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.765212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.765020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg72s\" (UniqueName: \"kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.765212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.765195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.765303 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.765244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.866132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.866096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.866132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.866140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg72s\" (UniqueName: \"kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.866353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.866193    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.866353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.866221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.866880 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.866855    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.868589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.868569    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.868680 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.868628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.874149 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.874128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg72s\" (UniqueName: \"kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s\") pod \"maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:43.972833 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:43.972810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:44.127256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.127224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7647-f6046a" event={"ID":"84dfae5c-8618-4325-a0d7-3ea498cd0bde","Type":"ContainerStarted","Data":"07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e"}
Sep 17 23:17:44.146597 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.146553    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7647-f6046a" podStartSLOduration=1.152230632 podStartE2EDuration="3.146536586s" totalImagesPullingTime="1.994305954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:44.145036851 +0000 UTC m=+703.023552100" watchObservedRunningTime="2026-09-17 23:17:44.146536586 +0000 UTC m=+703.025051831"
Sep 17 23:17:44.258437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.258403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:17:44.260879 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:44.260849    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418fb916_9441_4145_9d12_902dc2e72b2f.slice/crio-1eb17101b671e86dbdc66725fd752fd44e18f9baaf6edcc309305bbcdfb246a8 WatchSource:0}: Error finding container 1eb17101b671e86dbdc66725fd752fd44e18f9baaf6edcc309305bbcdfb246a8: Status 404 returned error can't find the container with id 1eb17101b671e86dbdc66725fd752fd44e18f9baaf6edcc309305bbcdfb246a8
Sep 17 23:17:44.641953 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.641930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:17:44.646720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.646703    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.648877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.648854    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-7aa654-serving-cert\""
Sep 17 23:17:44.656880 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.656850    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:17:44.730114 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.730083    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7647-f6046a"]
Sep 17 23:17:44.734760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.734733    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7647-f6046a"]
Sep 17 23:17:44.774281 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.774250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc2w6\" (UniqueName: \"kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.774422 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.774312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.774422 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.774332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.774422 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.774353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.851155 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.851081    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7647-0ee7cf"]
Sep 17 23:17:44.851514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.851498    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" containerName="test-curl-7647-f6046a"
Sep 17 23:17:44.851514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.851513    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" containerName="test-curl-7647-f6046a"
Sep 17 23:17:44.851663 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.851567    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" containerName="test-curl-7647-f6046a"
Sep 17 23:17:44.854731 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.854711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:44.863290 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.862920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7647-0ee7cf"]
Sep 17 23:17:44.874944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.874915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc2w6\" (UniqueName: \"kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.875084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.875024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.875156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.875104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.875156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.875147    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.875512 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:44.875315    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-serving-cert: secret "maas-api-e2e-inf-a-7aa654-serving-cert" not found
Sep 17 23:17:44.875512 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:44.875390    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls podName:0dbb6c21-e571-445d-bffc-126e849faa3c nodeName:}" failed. No retries permitted until 2026-09-17 23:17:45.375360642 +0000 UTC m=+704.253875881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls") pod "maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" (UID: "0dbb6c21-e571-445d-bffc-126e849faa3c") : secret "maas-api-e2e-inf-a-7aa654-serving-cert" not found
Sep 17 23:17:44.875887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.875863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.877724 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.877702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.887756 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.887735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc2w6\" (UniqueName: \"kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:44.976076 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:44.976011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfdsm\" (UniqueName: \"kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm\") pod \"test-curl-7647-0ee7cf\" (UID: \"795e0941-ee88-4c16-8d70-43bdc1265f7b\") " pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:45.077482 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.077440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfdsm\" (UniqueName: \"kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm\") pod \"test-curl-7647-0ee7cf\" (UID: \"795e0941-ee88-4c16-8d70-43bdc1265f7b\") " pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:45.085562 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.085531    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfdsm\" (UniqueName: \"kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm\") pod \"test-curl-7647-0ee7cf\" (UID: \"795e0941-ee88-4c16-8d70-43bdc1265f7b\") " pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:45.133972 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.133877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" event={"ID":"418fb916-9441-4145-9d12-902dc2e72b2f","Type":"ContainerStarted","Data":"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"}
Sep 17 23:17:45.133972 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.133932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" event={"ID":"418fb916-9441-4145-9d12-902dc2e72b2f","Type":"ContainerStarted","Data":"1eb17101b671e86dbdc66725fd752fd44e18f9baaf6edcc309305bbcdfb246a8"}
Sep 17 23:17:45.134214 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.134092    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:45.134279 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:45.134270    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7647-f6046a" container="test-curl-7647-f6046a"
Sep 17 23:17:45.155873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.155824    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" podStartSLOduration=1.786732499 podStartE2EDuration="2.155808221s" totalImagesPullingTime="369.075722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:45.154625969 +0000 UTC m=+704.033141216" watchObservedRunningTime="2026-09-17 23:17:45.155808221 +0000 UTC m=+704.034323466"
Sep 17 23:17:45.166678 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.166649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:45.380564 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.380532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:45.383178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.383151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") pod \"maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:45.442853 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.442824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7647-0ee7cf"]
Sep 17 23:17:45.444901 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:45.444865    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod795e0941_ee88_4c16_8d70_43bdc1265f7b.slice/crio-528e71b879af4b93882f4e6000c9c9e5fe98854ececb26f937d089bc24dd041e WatchSource:0}: Error finding container 528e71b879af4b93882f4e6000c9c9e5fe98854ececb26f937d089bc24dd041e: Status 404 returned error can't find the container with id 528e71b879af4b93882f4e6000c9c9e5fe98854ececb26f937d089bc24dd041e
Sep 17 23:17:45.589391 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.589353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:45.872195 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:45.872167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:17:45.872740 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:45.872710    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbb6c21_e571_445d_bffc_126e849faa3c.slice/crio-1dd7815a6b847a77ed380084f209ef24cf5f29b3a0cf3f087b03cbdc98ad65e7 WatchSource:0}: Error finding container 1dd7815a6b847a77ed380084f209ef24cf5f29b3a0cf3f087b03cbdc98ad65e7: Status 404 returned error can't find the container with id 1dd7815a6b847a77ed380084f209ef24cf5f29b3a0cf3f087b03cbdc98ad65e7
Sep 17 23:17:46.140172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.140086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" event={"ID":"0dbb6c21-e571-445d-bffc-126e849faa3c","Type":"ContainerStarted","Data":"1dd7815a6b847a77ed380084f209ef24cf5f29b3a0cf3f087b03cbdc98ad65e7"}
Sep 17 23:17:46.141507 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.141464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7647-0ee7cf" event={"ID":"795e0941-ee88-4c16-8d70-43bdc1265f7b","Type":"ContainerStarted","Data":"b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3"}
Sep 17 23:17:46.141627 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.141518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7647-0ee7cf" event={"ID":"795e0941-ee88-4c16-8d70-43bdc1265f7b","Type":"ContainerStarted","Data":"528e71b879af4b93882f4e6000c9c9e5fe98854ececb26f937d089bc24dd041e"}
Sep 17 23:17:46.141627 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.141528    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7647-f6046a" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" containerName="test-curl-7647-f6046a" containerID="cri-o://07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e" gracePeriod=2
Sep 17 23:17:46.159512 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.159466    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7647-0ee7cf" podStartSLOduration=2.159452908 podStartE2EDuration="2.159452908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:46.157168921 +0000 UTC m=+705.035684166" watchObservedRunningTime="2026-09-17 23:17:46.159452908 +0000 UTC m=+705.037968178"
Sep 17 23:17:46.742244 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.742210    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7647-0ee7cf"]
Sep 17 23:17:46.748924 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:46.748889    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7647-0ee7cf"]
Sep 17 23:17:47.148297 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:47.148252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" event={"ID":"0dbb6c21-e571-445d-bffc-126e849faa3c","Type":"ContainerStarted","Data":"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"}
Sep 17 23:17:47.148667 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:47.148426    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7647-0ee7cf" container="test-curl-7647-0ee7cf"
Sep 17 23:17:47.169493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:47.169447    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" podStartSLOduration=2.84873613 podStartE2EDuration="3.169432332s" totalImagesPullingTime="320.696202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:47.168131349 +0000 UTC m=+706.046646595" watchObservedRunningTime="2026-09-17 23:17:47.169432332 +0000 UTC m=+706.047947619"
Sep 17 23:17:48.153394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.153363    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7647-0ee7cf" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" containerName="test-curl-7647-0ee7cf" containerID="cri-o://b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3" gracePeriod=2
Sep 17 23:17:48.153394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.153382    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:48.334803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.334781    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:48.511992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.511959    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng9lc\" (UniqueName: \"kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc\") pod \"84dfae5c-8618-4325-a0d7-3ea498cd0bde\" (UID: \"84dfae5c-8618-4325-a0d7-3ea498cd0bde\") "
Sep 17 23:17:48.514210 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.514190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc" (OuterVolumeSpecName: "kube-api-access-ng9lc") pod "84dfae5c-8618-4325-a0d7-3ea498cd0bde" (UID: "84dfae5c-8618-4325-a0d7-3ea498cd0bde"). InnerVolumeSpecName "kube-api-access-ng9lc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:17:48.590956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.590925    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:17:48.591546 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.591520    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" containerName="test-curl-7647-0ee7cf"
Sep 17 23:17:48.591546 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.591546    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" containerName="test-curl-7647-0ee7cf"
Sep 17 23:17:48.591760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.591668    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" containerName="test-curl-7647-0ee7cf"
Sep 17 23:17:48.594700 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.594681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.597706 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.597687    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f10a7edb-openshift-default-dockercfg-75hs9\""
Sep 17 23:17:48.597839 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.597822    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 23:17:48.611473 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.611454    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:17:48.613075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.613039    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng9lc\" (UniqueName: \"kubernetes.io/projected/84dfae5c-8618-4325-a0d7-3ea498cd0bde-kube-api-access-ng9lc\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:17:48.713710 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.713890 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.713890 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.713890 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.713890 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdd9m\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.714030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.714030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.713999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.714127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.714035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.714127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.714073    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815205 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815205 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdd9m\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.815955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.815945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.816231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.816211    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.817734 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.817712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.817965 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.817946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.823417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.823396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.823502 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.823453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdd9m\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m\") pod \"e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") " pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:48.905572 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:48.905536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:49.047752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.047724    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:17:49.052434 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.052414    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.054589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.054567    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-0b4d93-serving-cert\""
Sep 17 23:17:49.060595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.060562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:17:49.160902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.160868    2581 generic.go:356] "Generic (PLEG): container finished" podID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" containerID="07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e" exitCode=137
Sep 17 23:17:49.161385 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.160922    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:49.161385 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.160967    2581 scope.go:117] "RemoveContainer" containerID="07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e"
Sep 17 23:17:49.170346 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.170328    2581 scope.go:117] "RemoveContainer" containerID="07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e"
Sep 17 23:17:49.170610 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:49.170590    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e\": container with ID starting with 07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e not found: ID does not exist" containerID="07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e"
Sep 17 23:17:49.170656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.170620    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e"} err="failed to get container status \"07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e\": rpc error: code = NotFound desc = could not find container \"07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e\": container with ID starting with 07293d8f2fa6a032ea31bf6b3cf8c63d45e4ae49aeff422a7cb3433c25ed2f0e not found: ID does not exist"
Sep 17 23:17:49.172521 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:49.172489    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7647-f6046a\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" pod="opendatahub/test-curl-7647-f6046a"
Sep 17 23:17:49.184970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.184952    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:17:49.187095 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:49.187070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc04960_4143_4a47_9a65_3b58ed6fc83e.slice/crio-e852d849c1453eef6eeb35f83b7dda56fc7b444dea7b8dd43e7a7a67e918491b WatchSource:0}: Error finding container e852d849c1453eef6eeb35f83b7dda56fc7b444dea7b8dd43e7a7a67e918491b: Status 404 returned error can't find the container with id e852d849c1453eef6eeb35f83b7dda56fc7b444dea7b8dd43e7a7a67e918491b
Sep 17 23:17:49.220193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.220158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.220335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.220244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqdwh\" (UniqueName: \"kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.220335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.220292    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.220417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.220359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.321511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.321474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.321681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.321574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqdwh\" (UniqueName: \"kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.321774 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.321758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.322078 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:49.321916    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-serving-cert: secret "maas-api-e2e-worker-w0-0b4d93-serving-cert" not found
Sep 17 23:17:49.322078 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:49.321994    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls podName:a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f nodeName:}" failed. No retries permitted until 2026-09-17 23:17:49.821968624 +0000 UTC m=+708.700483854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls") pod "maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" (UID: "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f") : secret "maas-api-e2e-worker-w0-0b4d93-serving-cert" not found
Sep 17 23:17:49.322256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.322236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.322567 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.322541    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.324135 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.324117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.329613 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.329593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqdwh\" (UniqueName: \"kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.665616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.662391    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84dfae5c-8618-4325-a0d7-3ea498cd0bde" path="/var/lib/kubelet/pods/84dfae5c-8618-4325-a0d7-3ea498cd0bde/volumes"
Sep 17 23:17:49.826154 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.826116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.828602 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.828578    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:49.964333 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:49.964243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:50.171206 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.171179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerStarted","Data":"e852d849c1453eef6eeb35f83b7dda56fc7b444dea7b8dd43e7a7a67e918491b"}
Sep 17 23:17:50.254951 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.254912    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:17:50.337976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.337949    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:50.338343 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.338319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfdsm\" (UniqueName: \"kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm\") pod \"795e0941-ee88-4c16-8d70-43bdc1265f7b\" (UID: \"795e0941-ee88-4c16-8d70-43bdc1265f7b\") "
Sep 17 23:17:50.340896 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.340871    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm" (OuterVolumeSpecName: "kube-api-access-zfdsm") pod "795e0941-ee88-4c16-8d70-43bdc1265f7b" (UID: "795e0941-ee88-4c16-8d70-43bdc1265f7b"). InnerVolumeSpecName "kube-api-access-zfdsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:17:50.439471 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:50.439430    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfdsm\" (UniqueName: \"kubernetes.io/projected/795e0941-ee88-4c16-8d70-43bdc1265f7b-kube-api-access-zfdsm\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:17:51.148951 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.148911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:17:51.177735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.177704    2581 generic.go:356] "Generic (PLEG): container finished" podID="795e0941-ee88-4c16-8d70-43bdc1265f7b" containerID="b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3" exitCode=137
Sep 17 23:17:51.178132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.177749    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:51.178132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.177825    2581 scope.go:117] "RemoveContainer" containerID="b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3"
Sep 17 23:17:51.180829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.180798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" event={"ID":"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f","Type":"ContainerStarted","Data":"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"}
Sep 17 23:17:51.180956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.180855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" event={"ID":"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f","Type":"ContainerStarted","Data":"75de164ec425fb39368a9fa6ded311aea3a70be20bb5b4524c4d65df45b543af"}
Sep 17 23:17:51.181533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.181114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:51.200686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.200274    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" podStartSLOduration=1.826340011 podStartE2EDuration="2.200254755s" totalImagesPullingTime="373.914744ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:51.199711668 +0000 UTC m=+710.078226917" watchObservedRunningTime="2026-09-17 23:17:51.200254755 +0000 UTC m=+710.078770001"
Sep 17 23:17:51.202083 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:51.202035    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7647-0ee7cf\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:51.660039 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:51.659997    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7647-0ee7cf\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" pod="opendatahub/test-curl-7647-0ee7cf"
Sep 17 23:17:51.662803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:51.662775    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="795e0941-ee88-4c16-8d70-43bdc1265f7b" path="/var/lib/kubelet/pods/795e0941-ee88-4c16-8d70-43bdc1265f7b/volumes"
Sep 17 23:17:52.058330 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.058304    2581 scope.go:117] "RemoveContainer" containerID="b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3"
Sep 17 23:17:52.058842 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:52.058794    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3\": container with ID starting with b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3 not found: ID does not exist" containerID="b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3"
Sep 17 23:17:52.058952 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.058850    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3"} err="failed to get container status \"b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3\": rpc error: code = NotFound desc = could not find container \"b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3\": container with ID starting with b89199247a86584bef455eac184712afaf93a68dacac4b3f75835c7c824115e3 not found: ID does not exist"
Sep 17 23:17:52.118633 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.118602    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:17:52.118703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.118673    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:17:52.118749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.118702    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:17:52.189854 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.189822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerStarted","Data":"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"}
Sep 17 23:17:52.211004 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.210942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podStartSLOduration=1.281960943 podStartE2EDuration="4.210921497s" totalImagesPullingTime="2.928960554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:52.208736987 +0000 UTC m=+711.087252260" watchObservedRunningTime="2026-09-17 23:17:52.210921497 +0000 UTC m=+711.089436743"
Sep 17 23:17:52.844727 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.844693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:17:52.906400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:52.906364    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:53.911695 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:53.911667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:54.167086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.167008    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:17:54.200633 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.200601    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:54.202234 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.202208    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:17:54.518584 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.518504    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:17:54.523805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.523782    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.526081 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.526057    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-6114ed-serving-cert\""
Sep 17 23:17:54.534569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.534491    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:17:54.576452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.576420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7kb\" (UniqueName: \"kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.576577 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.576477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.576577 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.576534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.576679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.576579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.677801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.677770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7kb\" (UniqueName: \"kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.677962 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.677825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.677962 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.677849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.677962 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.677883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.678518 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:54.678497    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-serving-cert: secret "maas-api-e2e-autores-6114ed-serving-cert" not found
Sep 17 23:17:54.678582 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:54.678560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls podName:70f8c511-7728-4804-b96b-6b2144e4d36c nodeName:}" failed. No retries permitted until 2026-09-17 23:17:55.178545005 +0000 UTC m=+714.057060234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls") pod "maas-api-e2e-autores-6114ed-7648f4ff44-658pz" (UID: "70f8c511-7728-4804-b96b-6b2144e4d36c") : secret "maas-api-e2e-autores-6114ed-serving-cert" not found
Sep 17 23:17:54.679151 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.679128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.680747 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.680723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:54.686700 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:54.686671    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7kb\" (UniqueName: \"kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:55.182758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.182278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:55.185108 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.185083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") pod \"maas-api-e2e-autores-6114ed-7648f4ff44-658pz\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:55.438521 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.438437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:55.524089 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.522880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:17:55.528525 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.528499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.530740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.530714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f10a7edb-serving-cert\""
Sep 17 23:17:55.544735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.544700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:17:55.586334 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.586300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.586498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.586412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.586498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.586441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.586498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.586496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scvjs\" (UniqueName: \"kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.687825 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.687792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.688001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.687847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.688001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.687911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scvjs\" (UniqueName: \"kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.688001 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:55.687954    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-serving-cert: secret "maas-api-e2e-ait-f10a7edb-serving-cert" not found
Sep 17 23:17:55.688197 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:17:55.688060    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls podName:a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624 nodeName:}" failed. No retries permitted until 2026-09-17 23:17:56.188022323 +0000 UTC m=+715.066537559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls") pod "maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" (UID: "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624") : secret "maas-api-e2e-ait-f10a7edb-serving-cert" not found
Sep 17 23:17:55.688197 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.688153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.689204 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.689141    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.690995 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.690973    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.697324 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.697300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scvjs\" (UniqueName: \"kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:55.713607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:55.713573    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:17:55.714431 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:55.714398    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f8c511_7728_4804_b96b_6b2144e4d36c.slice/crio-6c8dad91c3f335e85a248ea331a65f7817cf405b16b8989f23f548c8cad3a900 WatchSource:0}: Error finding container 6c8dad91c3f335e85a248ea331a65f7817cf405b16b8989f23f548c8cad3a900: Status 404 returned error can't find the container with id 6c8dad91c3f335e85a248ea331a65f7817cf405b16b8989f23f548c8cad3a900
Sep 17 23:17:56.193283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.193248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:56.195708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.195683    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") pod \"maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:56.212497 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.212463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" event={"ID":"70f8c511-7728-4804-b96b-6b2144e4d36c","Type":"ContainerStarted","Data":"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"}
Sep 17 23:17:56.212616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.212558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" event={"ID":"70f8c511-7728-4804-b96b-6b2144e4d36c","Type":"ContainerStarted","Data":"6c8dad91c3f335e85a248ea331a65f7817cf405b16b8989f23f548c8cad3a900"}
Sep 17 23:17:56.235281 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.235234    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" podStartSLOduration=1.892059167 podStartE2EDuration="2.235219258s" totalImagesPullingTime="343.160091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:56.234609999 +0000 UTC m=+715.113125249" watchObservedRunningTime="2026-09-17 23:17:56.235219258 +0000 UTC m=+715.113734530"
Sep 17 23:17:56.439414 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.439375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:56.710934 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:56.710910    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:17:56.712613 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:17:56.712587    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c3b1fe_b5fa_4470_89be_7cb4e1fc2624.slice/crio-e1bcd584d0f6767842cb1b4755ea230eaba77aa527c71d5eb43d582c9c436501 WatchSource:0}: Error finding container e1bcd584d0f6767842cb1b4755ea230eaba77aa527c71d5eb43d582c9c436501: Status 404 returned error can't find the container with id e1bcd584d0f6767842cb1b4755ea230eaba77aa527c71d5eb43d582c9c436501
Sep 17 23:17:57.195812 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.195780    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:17:57.222525 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.222488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" event={"ID":"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624","Type":"ContainerStarted","Data":"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"}
Sep 17 23:17:57.222718 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.222548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" event={"ID":"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624","Type":"ContainerStarted","Data":"e1bcd584d0f6767842cb1b4755ea230eaba77aa527c71d5eb43d582c9c436501"}
Sep 17 23:17:57.222781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.222731    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:17:57.222781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.222758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:17:57.242337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:17:57.242248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" podStartSLOduration=1.967556447 podStartE2EDuration="2.242231944s" totalImagesPullingTime="274.675497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:17:57.240001894 +0000 UTC m=+716.118517142" watchObservedRunningTime="2026-09-17 23:17:57.242231944 +0000 UTC m=+716.120747189"
Sep 17 23:18:03.233326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:03.233292    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:18:03.233911 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:03.233889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:18:08.353658 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.353623    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:18:08.358623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.358601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.362575 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.362551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8fc0d3-serving-cert\""
Sep 17 23:18:08.377098 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.377071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:18:08.412003 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.411957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.412565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.412543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.412877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.412861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.413026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.413012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zmpb\" (UniqueName: \"kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.513924 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.513883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.514158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.513932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zmpb\" (UniqueName: \"kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.514158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.513987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.514158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.514114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.514939 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.514905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.516727 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.516705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.516835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.516704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.525024 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.525001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zmpb\" (UniqueName: \"kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb\") pod \"maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.669873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.669836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:08.966949 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:08.966819    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:18:08.969685 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:18:08.969656    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102d60a1_2341_43a4_bb17_79826bbbba71.slice/crio-bd67bc5eb6cc9371ccb17580b3313eca2269522dc54ba0a2b3c48cfb56fe01bb WatchSource:0}: Error finding container bd67bc5eb6cc9371ccb17580b3313eca2269522dc54ba0a2b3c48cfb56fe01bb: Status 404 returned error can't find the container with id bd67bc5eb6cc9371ccb17580b3313eca2269522dc54ba0a2b3c48cfb56fe01bb
Sep 17 23:18:09.313314 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:09.313225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" event={"ID":"102d60a1-2341-43a4-bb17-79826bbbba71","Type":"ContainerStarted","Data":"bd67bc5eb6cc9371ccb17580b3313eca2269522dc54ba0a2b3c48cfb56fe01bb"}
Sep 17 23:18:10.320030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:10.319991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" event={"ID":"102d60a1-2341-43a4-bb17-79826bbbba71","Type":"ContainerStarted","Data":"714bbe2ff83414d6a2208a9387af049350db770bd12c1f640c790b75ea0ca0e3"}
Sep 17 23:18:10.320511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:10.320226    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:10.337212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:10.337156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" podStartSLOduration=1.9777588050000001 podStartE2EDuration="2.337137311s" totalImagesPullingTime="359.378506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:10.336699334 +0000 UTC m=+729.215214581" watchObservedRunningTime="2026-09-17 23:18:10.337137311 +0000 UTC m=+729.215652560"
Sep 17 23:18:15.848700 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:15.848664    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:18:16.330563 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.330539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:18:16.354553 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.354522    2581 generic.go:356] "Generic (PLEG): container finished" podID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerID="3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e" exitCode=0
Sep 17 23:18:16.354705 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.354596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerDied","Data":"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"}
Sep 17 23:18:16.354977 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.354964    2581 scope.go:117] "RemoveContainer" containerID="3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"
Sep 17 23:18:16.356076 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.356036    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:16.356145 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.356129    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:16.356183 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:16.356157    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:17.362667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:17.362632    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerStarted","Data":"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"}
Sep 17 23:18:17.906224 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:17.906167    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:17.906437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:17.906281    2581 patch_prober.go:28] interesting pod/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 23:18:17.906437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:17.906347    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 23:18:18.906105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:18.906032    2581 patch_prober.go:28] interesting pod/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 23:18:18.906599 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:18.906139    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 23:18:19.906247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:19.906213    2581 patch_prober.go:28] interesting pod/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 23:18:19.906804 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:19.906773    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 23:18:20.906294 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:20.906106    2581 patch_prober.go:28] interesting pod/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 23:18:20.906294 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:20.906195    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 23:18:21.906234 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:21.906198    2581 patch_prober.go:28] interesting pod/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 17 23:18:21.906406 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:21.906282    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 17 23:18:22.910722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:22.910690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:22.911124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:22.910942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:22.911541 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:22.911525    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:24.481675 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.481642    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:18:24.482167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.481952    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" podUID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" containerName="maas-api" containerID="cri-o://cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f" gracePeriod=30
Sep 17 23:18:24.743440 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.743383    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:18:24.879951 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.879919    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") pod \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") "
Sep 17 23:18:24.880158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.879997    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca\") pod \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") "
Sep 17 23:18:24.880158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.880104    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs\") pod \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") "
Sep 17 23:18:24.880283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.880191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scvjs\" (UniqueName: \"kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs\") pod \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\" (UID: \"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624\") "
Sep 17 23:18:24.880602 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.880364    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" (UID: "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:18:24.880602 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.880563    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:24.883771 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.883731    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" (UID: "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:18:24.883771 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.883741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs" (OuterVolumeSpecName: "kube-api-access-scvjs") pod "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" (UID: "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624"). InnerVolumeSpecName "kube-api-access-scvjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:18:24.883771 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.883752    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" (UID: "a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:18:24.936925 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.936894    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:18:24.981366 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.981328    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:24.981366 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.981365    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:24.981526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:24.981383    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scvjs\" (UniqueName: \"kubernetes.io/projected/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624-kube-api-access-scvjs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:25.411257 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411218    2581 generic.go:356] "Generic (PLEG): container finished" podID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" containerID="cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f" exitCode=0
Sep 17 23:18:25.411452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411264    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"
Sep 17 23:18:25.411452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" event={"ID":"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624","Type":"ContainerDied","Data":"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"}
Sep 17 23:18:25.411452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9" event={"ID":"a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624","Type":"ContainerDied","Data":"e1bcd584d0f6767842cb1b4755ea230eaba77aa527c71d5eb43d582c9c436501"}
Sep 17 23:18:25.411452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411395    2581 scope.go:117] "RemoveContainer" containerID="cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"
Sep 17 23:18:25.411677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.411643    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy" containerID="cri-o://87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad" gracePeriod=30
Sep 17 23:18:25.421088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.421071    2581 scope.go:117] "RemoveContainer" containerID="cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"
Sep 17 23:18:25.421370 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:18:25.421351    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f\": container with ID starting with cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f not found: ID does not exist" containerID="cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"
Sep 17 23:18:25.421427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.421378    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f"} err="failed to get container status \"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f\": rpc error: code = NotFound desc = could not find container \"cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f\": container with ID starting with cdd19ed23f7c6e27a0134d628e3325f8b0e7cefb19e228afaebe1fbc67387b5f not found: ID does not exist"
Sep 17 23:18:25.452200 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.452171    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:18:25.457016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.456995    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f10a7edb-85d8bf8b4b-gvqh9"]
Sep 17 23:18:25.662051 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.661969    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" path="/var/lib/kubelet/pods/a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624/volumes"
Sep 17 23:18:25.880093 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.880040    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:18:25.880701 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.880685    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" containerName="maas-api"
Sep 17 23:18:25.880770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.880703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" containerName="maas-api"
Sep 17 23:18:25.880826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.880813    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6c3b1fe-b5fa-4470-89be-7cb4e1fc2624" containerName="maas-api"
Sep 17 23:18:25.885676 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.885653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.888188 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.888165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b75118e5-gw-openshift-default-dockercfg-cfnwv\""
Sep 17 23:18:25.900558 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.900535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:18:25.989667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gxk6\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.989899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.990242 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:25.990242 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:25.989976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.090981 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.090948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.090996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gxk6\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091456    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.091806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.092027 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.092027 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.091888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.093719 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.093694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.093802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.093769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.099139 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.099110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.099250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.099228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gxk6\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6\") pod \"e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") " pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.196410 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.196375    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:26.477205 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.477172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:18:26.481962 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:18:26.478791    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc61ddd_0576_44ab_9c61_de1f1ee75f61.slice/crio-76a305335b19d07c9c393e37c025cdc086883a5d90fc35b69857bc9993d8cd29 WatchSource:0}: Error finding container 76a305335b19d07c9c393e37c025cdc086883a5d90fc35b69857bc9993d8cd29: Status 404 returned error can't find the container with id 76a305335b19d07c9c393e37c025cdc086883a5d90fc35b69857bc9993d8cd29
Sep 17 23:18:26.484135 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.484100    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:26.484224 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.484196    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:26.484264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:26.484239    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:27.423668 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:27.423630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerStarted","Data":"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"}
Sep 17 23:18:27.424165 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:27.423700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerStarted","Data":"76a305335b19d07c9c393e37c025cdc086883a5d90fc35b69857bc9993d8cd29"}
Sep 17 23:18:27.448250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:27.448198    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podStartSLOduration=2.448181786 podStartE2EDuration="2.448181786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:27.446584215 +0000 UTC m=+746.325099460" watchObservedRunningTime="2026-09-17 23:18:27.448181786 +0000 UTC m=+746.326697031"
Sep 17 23:18:28.197132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:28.197097    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:28.202344 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:28.202322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:28.429208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:28.429179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:28.430163 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:28.430142    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:30.684179 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.684094    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:30.840321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdd9m\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840493 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840488    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840585    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs\") pod \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\" (UID: \"9cc04960-4143-4a47-9a65-3b58ed6fc83e\") "
Sep 17 23:18:30.840810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840598    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:18:30.840810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840708    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:18:30.841019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840853    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:18:30.841019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:18:30.841019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840928    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.841019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840947    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.841019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.840956    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:18:30.842628 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.842599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:18:30.842752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.842732    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:18:30.842799 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.842753    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m" (OuterVolumeSpecName: "kube-api-access-gdd9m") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "kube-api-access-gdd9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:18:30.842935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.842919    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cc04960-4143-4a47-9a65-3b58ed6fc83e" (UID: "9cc04960-4143-4a47-9a65-3b58ed6fc83e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941392    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdd9m\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-kube-api-access-gdd9m\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941417    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941426    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941436    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941445    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941452    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:30.941466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:30.941460    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc04960-4143-4a47-9a65-3b58ed6fc83e-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:18:31.323216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.323132    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:18:31.324033 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324010    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.324231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324211    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.324326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324244    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.324326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.324409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324381    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.324409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.324395    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerName="istio-proxy"
Sep 17 23:18:31.328017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.327997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.330254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.330236    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b75118e5-serving-cert\""
Sep 17 23:18:31.338902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.338701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:18:31.445337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.445300    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.445518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.445421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.445518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.445448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.445518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.445467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsc2x\" (UniqueName: \"kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.447927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.447903    2581 generic.go:356] "Generic (PLEG): container finished" podID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" containerID="87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad" exitCode=0
Sep 17 23:18:31.448080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.447948    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerDied","Data":"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"}
Sep 17 23:18:31.448080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.447957    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"
Sep 17 23:18:31.448080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.447990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph" event={"ID":"9cc04960-4143-4a47-9a65-3b58ed6fc83e","Type":"ContainerDied","Data":"e852d849c1453eef6eeb35f83b7dda56fc7b444dea7b8dd43e7a7a67e918491b"}
Sep 17 23:18:31.448080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.448014    2581 scope.go:117] "RemoveContainer" containerID="87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"
Sep 17 23:18:31.457647 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.457628    2581 scope.go:117] "RemoveContainer" containerID="3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"
Sep 17 23:18:31.465769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.465754    2581 scope.go:117] "RemoveContainer" containerID="87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"
Sep 17 23:18:31.466024 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:18:31.466000    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad\": container with ID starting with 87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad not found: ID does not exist" containerID="87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"
Sep 17 23:18:31.466103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.466037    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad"} err="failed to get container status \"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad\": rpc error: code = NotFound desc = could not find container \"87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad\": container with ID starting with 87e1ebdfd98866e3679c1949403f0088e271659e2811592c5abb7d26c0b44cad not found: ID does not exist"
Sep 17 23:18:31.466103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.466084    2581 scope.go:117] "RemoveContainer" containerID="3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"
Sep 17 23:18:31.466349 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:18:31.466331    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e\": container with ID starting with 3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e not found: ID does not exist" containerID="3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"
Sep 17 23:18:31.466401 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.466353    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e"} err="failed to get container status \"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e\": rpc error: code = NotFound desc = could not find container \"3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e\": container with ID starting with 3514b9b10ac16832290f153cfefb1a2095904586221996cb96b775635a9dcc0e not found: ID does not exist"
Sep 17 23:18:31.470257 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.470237    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:18:31.474016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.473996    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f10a7edb-openshift-default-56957656f6-gf6ph"]
Sep 17 23:18:31.546121 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.546095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.546268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.546158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.546268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.546199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.546268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.546234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsc2x\" (UniqueName: \"kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.546840 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.546820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.548487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.548468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.548566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.548522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.554509 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.554486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsc2x\" (UniqueName: \"kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x\") pod \"maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.640835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.640737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:31.663012 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.662981    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc04960-4143-4a47-9a65-3b58ed6fc83e" path="/var/lib/kubelet/pods/9cc04960-4143-4a47-9a65-3b58ed6fc83e/volumes"
Sep 17 23:18:31.918238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:31.918212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:18:31.921217 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:18:31.921191    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b51010_16b9_4687_b461_7ddb18c1c38b.slice/crio-856f74cfb83afe11795f0caf6c9ad18b671793960326d065fa99be14470f1950 WatchSource:0}: Error finding container 856f74cfb83afe11795f0caf6c9ad18b671793960326d065fa99be14470f1950: Status 404 returned error can't find the container with id 856f74cfb83afe11795f0caf6c9ad18b671793960326d065fa99be14470f1950
Sep 17 23:18:32.455713 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:32.455673    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" event={"ID":"e8b51010-16b9-4687-b461-7ddb18c1c38b","Type":"ContainerStarted","Data":"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"}
Sep 17 23:18:32.455901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:32.455732    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" event={"ID":"e8b51010-16b9-4687-b461-7ddb18c1c38b","Type":"ContainerStarted","Data":"856f74cfb83afe11795f0caf6c9ad18b671793960326d065fa99be14470f1950"}
Sep 17 23:18:32.455901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:32.455785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:32.472425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:32.472330    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" podStartSLOduration=1.173274729 podStartE2EDuration="1.472312495s" totalImagesPullingTime="299.037766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:18:32.472040675 +0000 UTC m=+751.350555922" watchObservedRunningTime="2026-09-17 23:18:32.472312495 +0000 UTC m=+751.350827742"
Sep 17 23:18:35.550740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:35.550707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:18:38.467449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:38.467420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:18:44.470218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:44.470177    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 23:18:44.470638 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:44.470234    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 23:18:45.538805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.538706    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerID="0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b" exitCode=0
Sep 17 23:18:45.538805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.538779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerDied","Data":"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"}
Sep 17 23:18:45.539267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.539192    2581 scope.go:117] "RemoveContainer" containerID="0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"
Sep 17 23:18:45.540379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.540351    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:45.540442 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.540419    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:45.540479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:45.540448    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:18:46.545506 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:46.545474    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerStarted","Data":"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"}
Sep 17 23:18:47.196809 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:47.196777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:47.197108 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:47.196827    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 23:18:47.197275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:47.197250    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 23:18:48.197598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:48.197555    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 23:18:48.198218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:48.198180    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 23:18:49.197470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:49.197417    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 23:18:49.197665 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:49.197512    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 23:18:50.206069 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:50.205529    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 23:18:50.206069 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:50.205594    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 23:18:51.197011 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:51.196968    2581 patch_prober.go:28] interesting pod/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 17 23:18:51.197345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:51.197309    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 17 23:18:52.200930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:52.200899    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:52.201311 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:52.201264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:52.201960 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:52.201943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:18:57.863444 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:18:57.863407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:19:10.826486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:10.826452    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:19:10.826906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:10.826718    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" podUID="e8b51010-16b9-4687-b461-7ddb18c1c38b" containerName="maas-api" containerID="cri-o://34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83" gracePeriod=30
Sep 17 23:19:11.082414 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.082349    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:19:11.165981 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.165946    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:19:11.166606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.166570    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy" containerID="cri-o://46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3" gracePeriod=30
Sep 17 23:19:11.224317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca\") pod \"e8b51010-16b9-4687-b461-7ddb18c1c38b\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") "
Sep 17 23:19:11.224505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs\") pod \"e8b51010-16b9-4687-b461-7ddb18c1c38b\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") "
Sep 17 23:19:11.224505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls\") pod \"e8b51010-16b9-4687-b461-7ddb18c1c38b\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") "
Sep 17 23:19:11.224649 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224552    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsc2x\" (UniqueName: \"kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x\") pod \"e8b51010-16b9-4687-b461-7ddb18c1c38b\" (UID: \"e8b51010-16b9-4687-b461-7ddb18c1c38b\") "
Sep 17 23:19:11.224708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224683    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8b51010-16b9-4687-b461-7ddb18c1c38b" (UID: "e8b51010-16b9-4687-b461-7ddb18c1c38b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:11.224901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.224882    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8b51010-16b9-4687-b461-7ddb18c1c38b-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:11.226475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.226454    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8b51010-16b9-4687-b461-7ddb18c1c38b" (UID: "e8b51010-16b9-4687-b461-7ddb18c1c38b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:11.226857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.226840    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8b51010-16b9-4687-b461-7ddb18c1c38b" (UID: "e8b51010-16b9-4687-b461-7ddb18c1c38b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:11.226928 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.226866    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x" (OuterVolumeSpecName: "kube-api-access-nsc2x") pod "e8b51010-16b9-4687-b461-7ddb18c1c38b" (UID: "e8b51010-16b9-4687-b461-7ddb18c1c38b"). InnerVolumeSpecName "kube-api-access-nsc2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:11.326171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.326138    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsc2x\" (UniqueName: \"kubernetes.io/projected/e8b51010-16b9-4687-b461-7ddb18c1c38b-kube-api-access-nsc2x\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:11.326171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.326169    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:11.326171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.326178    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8b51010-16b9-4687-b461-7ddb18c1c38b-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:11.673886 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.673858    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8b51010-16b9-4687-b461-7ddb18c1c38b" containerID="34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83" exitCode=0
Sep 17 23:19:11.674022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.673892    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"
Sep 17 23:19:11.674022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.673896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" event={"ID":"e8b51010-16b9-4687-b461-7ddb18c1c38b","Type":"ContainerDied","Data":"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"}
Sep 17 23:19:11.674022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.673935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj" event={"ID":"e8b51010-16b9-4687-b461-7ddb18c1c38b","Type":"ContainerDied","Data":"856f74cfb83afe11795f0caf6c9ad18b671793960326d065fa99be14470f1950"}
Sep 17 23:19:11.674022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.673956    2581 scope.go:117] "RemoveContainer" containerID="34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"
Sep 17 23:19:11.683498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.683483    2581 scope.go:117] "RemoveContainer" containerID="34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"
Sep 17 23:19:11.683815 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:11.683796    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83\": container with ID starting with 34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83 not found: ID does not exist" containerID="34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"
Sep 17 23:19:11.683898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.683823    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83"} err="failed to get container status \"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83\": rpc error: code = NotFound desc = could not find container \"34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83\": container with ID starting with 34e3728707e8db221186cd28b3a416a339a81f018757080ac3ed8df12c4f1c83 not found: ID does not exist"
Sep 17 23:19:11.699764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.699729    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:19:11.707689 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.707664    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b75118e5-77fbd8bd89-dtssj"]
Sep 17 23:19:11.927824 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.927744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:11.928399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.928378    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8b51010-16b9-4687-b461-7ddb18c1c38b" containerName="maas-api"
Sep 17 23:19:11.928501 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.928402    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8b51010-16b9-4687-b461-7ddb18c1c38b" containerName="maas-api"
Sep 17 23:19:11.928561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.928518    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8b51010-16b9-4687-b461-7ddb18c1c38b" containerName="maas-api"
Sep 17 23:19:11.933221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.933195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:11.936199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.936030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-92cb6c75-openshift-default-dockercfg-sv7b7\""
Sep 17 23:19:11.944373 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:11.944348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:12.033484 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033491    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033808 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033808 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.033879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.033842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7ps\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.134948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.134909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.134964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.134993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7ps\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135776 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.135837 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.135816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.137941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.137912    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.138253 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.138234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.143466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.143442    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.143641 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.143624    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7ps\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps\") pod \"e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") " pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.246959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.246869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:12.529814 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.529722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:12.537836 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:19:12.537808    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode965aa5d_4dd7_4a8c_a999_c991c4a1022f.slice/crio-ed1f5ab0e9209620481ab3a6149e0345cb646b5aa5ff966b2f5fed50e756a032 WatchSource:0}: Error finding container ed1f5ab0e9209620481ab3a6149e0345cb646b5aa5ff966b2f5fed50e756a032: Status 404 returned error can't find the container with id ed1f5ab0e9209620481ab3a6149e0345cb646b5aa5ff966b2f5fed50e756a032
Sep 17 23:19:12.539937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.539907    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:12.539996 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.539971    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:12.540030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.539997    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:12.681680 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.681638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerStarted","Data":"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"}
Sep 17 23:19:12.681865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.681709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerStarted","Data":"ed1f5ab0e9209620481ab3a6149e0345cb646b5aa5ff966b2f5fed50e756a032"}
Sep 17 23:19:12.703718 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:12.703653    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podStartSLOduration=1.70363372 podStartE2EDuration="1.70363372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:12.702522293 +0000 UTC m=+791.581037540" watchObservedRunningTime="2026-09-17 23:19:12.70363372 +0000 UTC m=+791.582148968"
Sep 17 23:19:13.247220 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:13.247183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:13.253075 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:13.253025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:13.661640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:13.661605    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8b51010-16b9-4687-b461-7ddb18c1c38b" path="/var/lib/kubelet/pods/e8b51010-16b9-4687-b461-7ddb18c1c38b/volumes"
Sep 17 23:19:13.688594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:13.688561    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:13.689671 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:13.689649    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:16.440752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.440690    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:19:16.579249 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579213    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579258    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579314    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:16.579674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579635    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gxk6\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579646    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:16.579674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579662    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:16.579931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.579931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token\") pod \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\" (UID: \"1fc61ddd-0576-44ab-9c61-de1f1ee75f61\") "
Sep 17 23:19:16.580061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.579926    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:16.580182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.580079    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:16.580182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.580169    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.580285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.580196    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.580285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.580213    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.580285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.580248    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.581954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.581908    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:16.582313 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.581948    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:19:16.582313 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.582016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6" (OuterVolumeSpecName: "kube-api-access-4gxk6") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "kube-api-access-4gxk6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:16.582313 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.582206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fc61ddd-0576-44ab-9c61-de1f1ee75f61" (UID: "1fc61ddd-0576-44ab-9c61-de1f1ee75f61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:16.681623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.681577    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.681623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.681614    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.681623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.681627    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.681920 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.681640    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.681920 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.681653    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gxk6\" (UniqueName: \"kubernetes.io/projected/1fc61ddd-0576-44ab-9c61-de1f1ee75f61-kube-api-access-4gxk6\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:16.704687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.704594    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerID="46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3" exitCode=0
Sep 17 23:19:16.704687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.704646    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"
Sep 17 23:19:16.704889 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.704681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerDied","Data":"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"}
Sep 17 23:19:16.704889 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.704737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8" event={"ID":"1fc61ddd-0576-44ab-9c61-de1f1ee75f61","Type":"ContainerDied","Data":"76a305335b19d07c9c393e37c025cdc086883a5d90fc35b69857bc9993d8cd29"}
Sep 17 23:19:16.704889 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.704769    2581 scope.go:117] "RemoveContainer" containerID="46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"
Sep 17 23:19:16.714430 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.714414    2581 scope.go:117] "RemoveContainer" containerID="0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"
Sep 17 23:19:16.722338 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.722319    2581 scope.go:117] "RemoveContainer" containerID="46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"
Sep 17 23:19:16.722603 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:16.722585    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3\": container with ID starting with 46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3 not found: ID does not exist" containerID="46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"
Sep 17 23:19:16.722669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.722610    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3"} err="failed to get container status \"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3\": rpc error: code = NotFound desc = could not find container \"46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3\": container with ID starting with 46930914bec88e2f75f27cb4210dd4f3c704e22c9a94098d718eef5dd175e8d3 not found: ID does not exist"
Sep 17 23:19:16.722669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.722626    2581 scope.go:117] "RemoveContainer" containerID="0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"
Sep 17 23:19:16.722879 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:16.722855    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b\": container with ID starting with 0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b not found: ID does not exist" containerID="0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"
Sep 17 23:19:16.722926 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.722884    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b"} err="failed to get container status \"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b\": rpc error: code = NotFound desc = could not find container \"0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b\": container with ID starting with 0dcd71b445eef32953f792eac193c15a7a4f9a86479705602589d6459cf09c7b not found: ID does not exist"
Sep 17 23:19:16.726955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.726932    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:19:16.736552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.733026    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b75118e5-gw-openshift-default-7c97b9bc84-wwqb8"]
Sep 17 23:19:16.817954 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.817909    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:16.818574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.818556    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:16.818574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.818572    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:16.818733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.818598    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:16.818733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.818607    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:16.818733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.818701    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:16.823733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.823714    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:16.826275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.826246    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-92cb6c75-serving-cert\""
Sep 17 23:19:16.835407 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.835372    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:16.985192 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.985093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:16.985192 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.985154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:16.985398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.985264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:16.985448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:16.985420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdqzl\" (UniqueName: \"kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.086398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.086362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdqzl\" (UniqueName: \"kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.086591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.086417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.086591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.086444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.086591 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.086506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.087158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.087126    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.088935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.088911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.089027 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.088943    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.095179 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.095158    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdqzl\" (UniqueName: \"kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl\") pod \"maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.137211 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.137179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:17.418966 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.418933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:17.420448 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:19:17.420427    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af7c6aa_f4c7_4fae_8b58_9d6fd4aa2283.slice/crio-ed668b0319f32c39e1bd333840e006e0e2265f1dceeeef537250216658654521 WatchSource:0}: Error finding container ed668b0319f32c39e1bd333840e006e0e2265f1dceeeef537250216658654521: Status 404 returned error can't find the container with id ed668b0319f32c39e1bd333840e006e0e2265f1dceeeef537250216658654521
Sep 17 23:19:17.467247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.467210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:19:17.660687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.660658    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" path="/var/lib/kubelet/pods/1fc61ddd-0576-44ab-9c61-de1f1ee75f61/volumes"
Sep 17 23:19:17.712180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:17.712100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" event={"ID":"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283","Type":"ContainerStarted","Data":"ed668b0319f32c39e1bd333840e006e0e2265f1dceeeef537250216658654521"}
Sep 17 23:19:18.719780 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:18.719740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" event={"ID":"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283","Type":"ContainerStarted","Data":"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"}
Sep 17 23:19:18.720201 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:18.719894    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:18.737579 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:18.737530    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" podStartSLOduration=2.350484564 podStartE2EDuration="2.737513368s" totalImagesPullingTime="387.028804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:18.736464888 +0000 UTC m=+797.614980135" watchObservedRunningTime="2026-09-17 23:19:18.737513368 +0000 UTC m=+797.616028613"
Sep 17 23:19:24.731090 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:24.730999    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:36.561587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:36.561551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:19:39.845953 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.845920    2581 generic.go:356] "Generic (PLEG): container finished" podID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerID="44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1" exitCode=0
Sep 17 23:19:39.846413 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.845990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerDied","Data":"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"}
Sep 17 23:19:39.846413 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.846406    2581 scope.go:117] "RemoveContainer" containerID="44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"
Sep 17 23:19:39.847485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.847457    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:39.847593 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.847534    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:39.847593 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:39.847580    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:40.853547 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:40.853508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerStarted","Data":"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"}
Sep 17 23:19:41.247073 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:41.247018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:41.247992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:41.247970    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:41.248078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:41.248016    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:42.247475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:42.247438    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:42.247884 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:42.247495    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:43.247369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:43.247327    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:43.247534 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:43.247391    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:43.688877 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:43.688841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:44.247655 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:44.247618    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:44.248035 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:44.247683    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:45.248137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:45.248100    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:45.248551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:45.248167    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:46.247452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:46.247414    2581 patch_prober.go:28] interesting pod/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 17 23:19:46.247640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:46.247475    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 17 23:19:47.251517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:47.251489    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:47.252432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:47.252402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:48.990857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:48.990808    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:48.991465 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:48.991061    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" podUID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" containerName="maas-api" containerID="cri-o://c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775" gracePeriod=30
Sep 17 23:19:49.236733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.236706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:49.278272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.278195    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs\") pod \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") "
Sep 17 23:19:49.278272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.278254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdqzl\" (UniqueName: \"kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl\") pod \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") "
Sep 17 23:19:49.278491 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.278284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls\") pod \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") "
Sep 17 23:19:49.278491 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.278349    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca\") pod \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\" (UID: \"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283\") "
Sep 17 23:19:49.278767 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.278739    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" (UID: "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:49.280872 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.280843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" (UID: "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:49.280978 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.280953    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" (UID: "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:49.283212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.283190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl" (OuterVolumeSpecName: "kube-api-access-jdqzl") pod "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" (UID: "9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283"). InnerVolumeSpecName "kube-api-access-jdqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:49.380001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.379966    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:49.380001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.379994    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdqzl\" (UniqueName: \"kubernetes.io/projected/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-kube-api-access-jdqzl\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:49.380001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.380004    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:49.380250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.380013    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:49.903018 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.902985    2581 generic.go:356] "Generic (PLEG): container finished" podID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" containerID="c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775" exitCode=0
Sep 17 23:19:49.903202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.903031    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"
Sep 17 23:19:49.903202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.903076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" event={"ID":"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283","Type":"ContainerDied","Data":"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"}
Sep 17 23:19:49.903202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.903130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf" event={"ID":"9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283","Type":"ContainerDied","Data":"ed668b0319f32c39e1bd333840e006e0e2265f1dceeeef537250216658654521"}
Sep 17 23:19:49.903202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.903144    2581 scope.go:117] "RemoveContainer" containerID="c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"
Sep 17 23:19:49.912040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.912020    2581 scope.go:117] "RemoveContainer" containerID="c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"
Sep 17 23:19:49.912319 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:49.912298    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775\": container with ID starting with c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775 not found: ID does not exist" containerID="c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"
Sep 17 23:19:49.912387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.912328    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775"} err="failed to get container status \"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775\": rpc error: code = NotFound desc = could not find container \"c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775\": container with ID starting with c7fcebe263955b23cd5525fd136c276c3760ffa568bb79267ee05aa3ad491775 not found: ID does not exist"
Sep 17 23:19:49.918255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.918232    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:49.921572 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:49.921512    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-92cb6c75-845ccc996f-c2vbf"]
Sep 17 23:19:50.342182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:50.342099    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:50.342609 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:50.342551    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy" containerID="cri-o://a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b" gracePeriod=30
Sep 17 23:19:50.741597 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:50.741555    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:19:51.098392 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.098307    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:19:51.099016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.098990    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" containerName="maas-api"
Sep 17 23:19:51.099016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.099012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" containerName="maas-api"
Sep 17 23:19:51.099256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.099155    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fc61ddd-0576-44ab-9c61-de1f1ee75f61" containerName="istio-proxy"
Sep 17 23:19:51.099256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.099171    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" containerName="maas-api"
Sep 17 23:19:51.103857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.103836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.106369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.106343    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-57a4f2d1-openshift-default-dockercfg-j97m7\""
Sep 17 23:19:51.116682 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.116658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:19:51.198601 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198601 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198762    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmxhh\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198816    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.198865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198841    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.199365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.198909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmxhh\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300525    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300964 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.300964 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.300949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.301202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.301178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.301270 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.301240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.301392 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.301375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.302948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.302922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.303168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.303152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.309085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.309058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.310127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.309604    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmxhh\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh\") pod \"e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") " pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.414545 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.414516    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:51.662091 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.662038    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283" path="/var/lib/kubelet/pods/9af7c6aa-f4c7-4fae-8b58-9d6fd4aa2283/volumes"
Sep 17 23:19:51.695190 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.695163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:19:51.697407 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:19:51.697374    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4177c9ad_5b57_4b06_ba22_4d94dfee3b4b.slice/crio-fb33f7fc95c036737eaf1917c006b86f83836907e5597c95b59f9305633be985 WatchSource:0}: Error finding container fb33f7fc95c036737eaf1917c006b86f83836907e5597c95b59f9305633be985: Status 404 returned error can't find the container with id fb33f7fc95c036737eaf1917c006b86f83836907e5597c95b59f9305633be985
Sep 17 23:19:51.699628 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.699593    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:51.699712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.699659    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:51.699712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.699691    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:19:51.918231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.918194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerStarted","Data":"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"}
Sep 17 23:19:51.918411 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.918258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerStarted","Data":"fb33f7fc95c036737eaf1917c006b86f83836907e5597c95b59f9305633be985"}
Sep 17 23:19:51.941864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:51.941801    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podStartSLOduration=0.941779264 podStartE2EDuration="941.779264ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:51.938415701 +0000 UTC m=+830.816930950" watchObservedRunningTime="2026-09-17 23:19:51.941779264 +0000 UTC m=+830.820294511"
Sep 17 23:19:52.414810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:52.414772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:52.416327 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:52.416296    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:19:52.416407 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:52.416349    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:19:53.419175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:53.419141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:53.928968 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:53.928934    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:53.930033 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:53.930013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:19:55.597868 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.597843    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:55.745302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745391    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj7ps\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745466    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745501    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745542    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745570    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy\") pod \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\" (UID: \"e965aa5d-4dd7-4a8c-a999-c991c4a1022f\") "
Sep 17 23:19:55.745755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:55.745755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:55.745992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745917    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:55.745992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.745934    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:55.746149 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.746110    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.746203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.746146    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.746203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.746166    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.746203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.746180    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.746629 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.746595    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:55.747643 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.747601    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:55.747953 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.747926    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:19:55.747953 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.747940    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps" (OuterVolumeSpecName: "kube-api-access-kj7ps") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "kube-api-access-kj7ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:55.748083 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.747988    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e965aa5d-4dd7-4a8c-a999-c991c4a1022f" (UID: "e965aa5d-4dd7-4a8c-a999-c991c4a1022f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:19:55.847485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.847457    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.847485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.847481    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj7ps\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-kube-api-access-kj7ps\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.847485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.847491    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.847742 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.847500    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.847742 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.847507    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e965aa5d-4dd7-4a8c-a999-c991c4a1022f-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:55.940993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.940963    2581 generic.go:356] "Generic (PLEG): container finished" podID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerID="a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b" exitCode=0
Sep 17 23:19:55.941175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.941010    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"
Sep 17 23:19:55.941175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.941069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerDied","Data":"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"}
Sep 17 23:19:55.941175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.941150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5" event={"ID":"e965aa5d-4dd7-4a8c-a999-c991c4a1022f","Type":"ContainerDied","Data":"ed1f5ab0e9209620481ab3a6149e0345cb646b5aa5ff966b2f5fed50e756a032"}
Sep 17 23:19:55.941306 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.941185    2581 scope.go:117] "RemoveContainer" containerID="a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"
Sep 17 23:19:55.952859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.952828    2581 scope.go:117] "RemoveContainer" containerID="44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"
Sep 17 23:19:55.961581 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.961563    2581 scope.go:117] "RemoveContainer" containerID="a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"
Sep 17 23:19:55.961831 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:55.961814    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b\": container with ID starting with a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b not found: ID does not exist" containerID="a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"
Sep 17 23:19:55.961897 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.961839    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b"} err="failed to get container status \"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b\": rpc error: code = NotFound desc = could not find container \"a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b\": container with ID starting with a096869dbc93620c16e160ae1f6ea64cf6e7fbbc70365cd3b6e9025f4804fb0b not found: ID does not exist"
Sep 17 23:19:55.961897 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.961853    2581 scope.go:117] "RemoveContainer" containerID="44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"
Sep 17 23:19:55.962127 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:55.962110    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1\": container with ID starting with 44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1 not found: ID does not exist" containerID="44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"
Sep 17 23:19:55.962175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.962130    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1"} err="failed to get container status \"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1\": rpc error: code = NotFound desc = could not find container \"44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1\": container with ID starting with 44aef45800651955e304956c6ab34926601a72c2785f35737e449c05acafd8d1 not found: ID does not exist"
Sep 17 23:19:55.962937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.962919    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:55.968008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:55.967989    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-92cb6c75-openshift-default-6b85594bb-5wxw5"]
Sep 17 23:19:57.140711 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.140680    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:19:57.141134 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.140943    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" podUID="70f8c511-7728-4804-b96b-6b2144e4d36c" containerName="maas-api" containerID="cri-o://2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920" gracePeriod=30
Sep 17 23:19:57.402793 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.402740    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:19:57.429309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429285    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:19:57.429742 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429725    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:19:57.429835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429745    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:19:57.429835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429783    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70f8c511-7728-4804-b96b-6b2144e4d36c" containerName="maas-api"
Sep 17 23:19:57.429835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429793    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="70f8c511-7728-4804-b96b-6b2144e4d36c" containerName="maas-api"
Sep 17 23:19:57.429835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429812    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:19:57.429835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429821    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:19:57.430088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429924    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:19:57.430088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.429937    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="70f8c511-7728-4804-b96b-6b2144e4d36c" containerName="maas-api"
Sep 17 23:19:57.432986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.432968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.435401 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.435378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-57a4f2d1-serving-cert\""
Sep 17 23:19:57.449290 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.449266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:19:57.562181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562147    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca\") pod \"70f8c511-7728-4804-b96b-6b2144e4d36c\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") "
Sep 17 23:19:57.562363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562256    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") pod \"70f8c511-7728-4804-b96b-6b2144e4d36c\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") "
Sep 17 23:19:57.562363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562327    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb7kb\" (UniqueName: \"kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb\") pod \"70f8c511-7728-4804-b96b-6b2144e4d36c\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") "
Sep 17 23:19:57.562363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562355    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs\") pod \"70f8c511-7728-4804-b96b-6b2144e4d36c\" (UID: \"70f8c511-7728-4804-b96b-6b2144e4d36c\") "
Sep 17 23:19:57.562548 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.562548 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.562644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "70f8c511-7728-4804-b96b-6b2144e4d36c" (UID: "70f8c511-7728-4804-b96b-6b2144e4d36c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:19:57.562760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.562850 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v2lp\" (UniqueName: \"kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.562967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.562951    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/70f8c511-7728-4804-b96b-6b2144e4d36c-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:57.564795 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.564756    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "70f8c511-7728-4804-b96b-6b2144e4d36c" (UID: "70f8c511-7728-4804-b96b-6b2144e4d36c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:57.564795 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.564768    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb" (OuterVolumeSpecName: "kube-api-access-xb7kb") pod "70f8c511-7728-4804-b96b-6b2144e4d36c" (UID: "70f8c511-7728-4804-b96b-6b2144e4d36c"). InnerVolumeSpecName "kube-api-access-xb7kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:19:57.564940 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.564828    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "70f8c511-7728-4804-b96b-6b2144e4d36c" (UID: "70f8c511-7728-4804-b96b-6b2144e4d36c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:19:57.661925 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.661895    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" path="/var/lib/kubelet/pods/e965aa5d-4dd7-4a8c-a999-c991c4a1022f/volumes"
Sep 17 23:19:57.663501 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v2lp\" (UniqueName: \"kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.663563 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.663563 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.663652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663614    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.663696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663658    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb7kb\" (UniqueName: \"kubernetes.io/projected/70f8c511-7728-4804-b96b-6b2144e4d36c-kube-api-access-xb7kb\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:57.663696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663675    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:57.663696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.663688    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/70f8c511-7728-4804-b96b-6b2144e4d36c-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:19:57.664334 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.664310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.665988 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.665962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.666110 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.666004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.671725 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.671702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v2lp\" (UniqueName: \"kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp\") pod \"maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.752428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.752398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:57.953679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.953598    2581 generic.go:356] "Generic (PLEG): container finished" podID="70f8c511-7728-4804-b96b-6b2144e4d36c" containerID="2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920" exitCode=0
Sep 17 23:19:57.953679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.953646    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"
Sep 17 23:19:57.953901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.953683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" event={"ID":"70f8c511-7728-4804-b96b-6b2144e4d36c","Type":"ContainerDied","Data":"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"}
Sep 17 23:19:57.953901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.953745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz" event={"ID":"70f8c511-7728-4804-b96b-6b2144e4d36c","Type":"ContainerDied","Data":"6c8dad91c3f335e85a248ea331a65f7817cf405b16b8989f23f548c8cad3a900"}
Sep 17 23:19:57.953901 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.953777    2581 scope.go:117] "RemoveContainer" containerID="2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"
Sep 17 23:19:57.963067 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.963054    2581 scope.go:117] "RemoveContainer" containerID="2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"
Sep 17 23:19:57.963349 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:19:57.963329    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920\": container with ID starting with 2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920 not found: ID does not exist" containerID="2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"
Sep 17 23:19:57.963451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.963370    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920"} err="failed to get container status \"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920\": rpc error: code = NotFound desc = could not find container \"2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920\": container with ID starting with 2b5db5cfd3036dcf6879b6fc3557243104b8e7977bd0c0c2622c7ad688e84920 not found: ID does not exist"
Sep 17 23:19:57.970368 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.970348    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:19:57.976010 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:57.975989    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-6114ed-7648f4ff44-658pz"]
Sep 17 23:19:58.025107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:58.025082    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:19:58.027328 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:19:58.027302    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc3cf53_d1df_44e6_a925_754767822986.slice/crio-417cfff92ca2d4934a1045c75b832f0eeba175e95676a1fb590546b3d354a24d WatchSource:0}: Error finding container 417cfff92ca2d4934a1045c75b832f0eeba175e95676a1fb590546b3d354a24d: Status 404 returned error can't find the container with id 417cfff92ca2d4934a1045c75b832f0eeba175e95676a1fb590546b3d354a24d
Sep 17 23:19:58.967483 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:58.967445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" event={"ID":"ccc3cf53-d1df-44e6-a925-754767822986","Type":"ContainerStarted","Data":"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"}
Sep 17 23:19:58.967915 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:58.967516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" event={"ID":"ccc3cf53-d1df-44e6-a925-754767822986","Type":"ContainerStarted","Data":"417cfff92ca2d4934a1045c75b832f0eeba175e95676a1fb590546b3d354a24d"}
Sep 17 23:19:58.967915 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:58.967588    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:19:58.992111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:58.992065    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" podStartSLOduration=1.584024217 podStartE2EDuration="1.992036789s" totalImagesPullingTime="408.012572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:19:58.989838392 +0000 UTC m=+837.868353637" watchObservedRunningTime="2026-09-17 23:19:58.992036789 +0000 UTC m=+837.870552034"
Sep 17 23:19:59.661602 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:19:59.661568    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70f8c511-7728-4804-b96b-6b2144e4d36c" path="/var/lib/kubelet/pods/70f8c511-7728-4804-b96b-6b2144e4d36c/volumes"
Sep 17 23:20:04.978669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:04.978641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:20:07.359568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:07.359535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:20:09.841624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.841594    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:20:09.842314 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.842294    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e965aa5d-4dd7-4a8c-a999-c991c4a1022f" containerName="istio-proxy"
Sep 17 23:20:09.847326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.847302    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.851169 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.851147    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f324fe-openshift-default-dockercfg-dfm2b\""
Sep 17 23:20:09.867187 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.867160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqsf8\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.885730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.885600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.989203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.988924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqsf8\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.990474 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.990076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.990760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.990733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.991871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.991216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.992006 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.991778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.996700 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.991816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:09.996857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:09.996632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:10.008459 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.008416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:10.011930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.011899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:10.012140 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.012035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqsf8\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8\") pod \"e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") " pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:10.157471 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.157439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:10.496681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.495134    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:20:10.509422 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:20:10.509245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37940560_e3dc_428a_a982_5783f5990f5a.slice/crio-079b3c1972d135ba79c47fe7bd25421b6b599d99851d78535d55199aa63be0c5 WatchSource:0}: Error finding container 079b3c1972d135ba79c47fe7bd25421b6b599d99851d78535d55199aa63be0c5: Status 404 returned error can't find the container with id 079b3c1972d135ba79c47fe7bd25421b6b599d99851d78535d55199aa63be0c5
Sep 17 23:20:10.511168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.511135    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:10.511260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.511207    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:10.511260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:10.511233    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:11.038102 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:11.038031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerStarted","Data":"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"}
Sep 17 23:20:11.038566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:11.038121    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerStarted","Data":"079b3c1972d135ba79c47fe7bd25421b6b599d99851d78535d55199aa63be0c5"}
Sep 17 23:20:11.065803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:11.065753    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podStartSLOduration=2.06573517 podStartE2EDuration="2.06573517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:20:11.063318038 +0000 UTC m=+849.941833284" watchObservedRunningTime="2026-09-17 23:20:11.06573517 +0000 UTC m=+849.944250415"
Sep 17 23:20:11.157869 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:11.157840    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:11.163310 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:11.163281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:12.043803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:12.043772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:12.044843 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:12.044824    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:17.513013 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.512981    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:20:17.518989 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.518961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.522655 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.522323    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-f324fe-serving-cert\""
Sep 17 23:20:17.530753 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.529701    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:20:17.575103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.575068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.575301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.575135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.575301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.575171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.575301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.575197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2clsh\" (UniqueName: \"kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.676059 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.676014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.676211 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.676080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.676211 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.676106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.676211 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:20:17.676182    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-serving-cert: secret "maas-api-e2e-explicit-f324fe-serving-cert" not found
Sep 17 23:20:17.676366 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:20:17.676257    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls podName:5ccaa123-fb38-421a-86b1-93d1d6a6a4e5 nodeName:}" failed. No retries permitted until 2026-09-17 23:20:18.176233979 +0000 UTC m=+857.054749209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls") pod "maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" (UID: "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5") : secret "maas-api-e2e-explicit-f324fe-serving-cert" not found
Sep 17 23:20:17.676366 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.676280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2clsh\" (UniqueName: \"kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.677037 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.677012    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.678551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.678532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:17.685439 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:17.685404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2clsh\" (UniqueName: \"kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:18.077469 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.077433    2581 generic.go:356] "Generic (PLEG): container finished" podID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerID="df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162" exitCode=0
Sep 17 23:20:18.077677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.077508    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerDied","Data":"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"}
Sep 17 23:20:18.077942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.077929    2581 scope.go:117] "RemoveContainer" containerID="df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"
Sep 17 23:20:18.079146 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.079112    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:18.079276 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.079201    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:18.079276 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.079250    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:18.181553 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.181515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:18.184511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.184482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") pod \"maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:18.434949 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.434906    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:18.725722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:18.725692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:20:18.727916 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:20:18.727890    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ccaa123_fb38_421a_86b1_93d1d6a6a4e5.slice/crio-37372ae0cd3a70bc5987356801920a122305833a0ab9a454ac19615096897b2c WatchSource:0}: Error finding container 37372ae0cd3a70bc5987356801920a122305833a0ab9a454ac19615096897b2c: Status 404 returned error can't find the container with id 37372ae0cd3a70bc5987356801920a122305833a0ab9a454ac19615096897b2c
Sep 17 23:20:19.090624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:19.090519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerStarted","Data":"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"}
Sep 17 23:20:19.092792 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:19.092753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" event={"ID":"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5","Type":"ContainerStarted","Data":"37372ae0cd3a70bc5987356801920a122305833a0ab9a454ac19615096897b2c"}
Sep 17 23:20:19.415400 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:19.415368    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:20:19.416557 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:19.416533    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:20:19.416651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:19.416584    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:20:20.107118 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:20.107081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" event={"ID":"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5","Type":"ContainerStarted","Data":"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"}
Sep 17 23:20:20.107680 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:20.107660    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:20.133920 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:20.133869    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" podStartSLOduration=2.732236687 podStartE2EDuration="3.133851821s" totalImagesPullingTime="401.615134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:20:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:20:20.132721977 +0000 UTC m=+859.011237250" watchObservedRunningTime="2026-09-17 23:20:20.133851821 +0000 UTC m=+859.012367067"
Sep 17 23:20:20.415314 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:20.415273    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:20:20.415514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:20.415330    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:20:21.415544 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:21.415508    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:20:21.415950 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:21.415564    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:20:22.415744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:22.415706    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:20:22.416259 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:22.415802    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:20:23.415210 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:23.415173    2581 patch_prober.go:28] interesting pod/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 17 23:20:23.415414 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:23.415231    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 17 23:20:23.764409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:23.764326    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:20:23.764899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:23.764527    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" podUID="ccc3cf53-d1df-44e6-a925-754767822986" containerName="maas-api" containerID="cri-o://3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7" gracePeriod=30
Sep 17 23:20:23.929384 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:23.929341    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:20:24.050423 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.050389    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:20:24.103101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.103021    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:20:24.130235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130201    2581 generic.go:356] "Generic (PLEG): container finished" podID="ccc3cf53-d1df-44e6-a925-754767822986" containerID="3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7" exitCode=0
Sep 17 23:20:24.130425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130253    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"
Sep 17 23:20:24.130425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130273    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" event={"ID":"ccc3cf53-d1df-44e6-a925-754767822986","Type":"ContainerDied","Data":"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"}
Sep 17 23:20:24.130425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm" event={"ID":"ccc3cf53-d1df-44e6-a925-754767822986","Type":"ContainerDied","Data":"417cfff92ca2d4934a1045c75b832f0eeba175e95676a1fb590546b3d354a24d"}
Sep 17 23:20:24.130425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130370    2581 scope.go:117] "RemoveContainer" containerID="3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"
Sep 17 23:20:24.130634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.130482    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy" containerID="cri-o://5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7" gracePeriod=30
Sep 17 23:20:24.143946 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.143921    2581 scope.go:117] "RemoveContainer" containerID="3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"
Sep 17 23:20:24.144394 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:20:24.144364    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7\": container with ID starting with 3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7 not found: ID does not exist" containerID="3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"
Sep 17 23:20:24.144517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.144401    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7"} err="failed to get container status \"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7\": rpc error: code = NotFound desc = could not find container \"3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7\": container with ID starting with 3c991a632ae6a76955d5b613ba818d3ec4b9196a325cc32390cbe98d5ab8aaa7 not found: ID does not exist"
Sep 17 23:20:24.147828 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.147796    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls\") pod \"ccc3cf53-d1df-44e6-a925-754767822986\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") "
Sep 17 23:20:24.147958 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.147918    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs\") pod \"ccc3cf53-d1df-44e6-a925-754767822986\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") "
Sep 17 23:20:24.147958 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.147954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v2lp\" (UniqueName: \"kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp\") pod \"ccc3cf53-d1df-44e6-a925-754767822986\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") "
Sep 17 23:20:24.148105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.148009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca\") pod \"ccc3cf53-d1df-44e6-a925-754767822986\" (UID: \"ccc3cf53-d1df-44e6-a925-754767822986\") "
Sep 17 23:20:24.148725 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.148695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccc3cf53-d1df-44e6-a925-754767822986" (UID: "ccc3cf53-d1df-44e6-a925-754767822986"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:20:24.150704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.150660    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccc3cf53-d1df-44e6-a925-754767822986" (UID: "ccc3cf53-d1df-44e6-a925-754767822986"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:20:24.150900 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.150877    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccc3cf53-d1df-44e6-a925-754767822986" (UID: "ccc3cf53-d1df-44e6-a925-754767822986"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:20:24.151018 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.150950    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp" (OuterVolumeSpecName: "kube-api-access-7v2lp") pod "ccc3cf53-d1df-44e6-a925-754767822986" (UID: "ccc3cf53-d1df-44e6-a925-754767822986"). InnerVolumeSpecName "kube-api-access-7v2lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:20:24.249103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.249065    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:24.249103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.249097    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v2lp\" (UniqueName: \"kubernetes.io/projected/ccc3cf53-d1df-44e6-a925-754767822986-kube-api-access-7v2lp\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:24.249103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.249107    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccc3cf53-d1df-44e6-a925-754767822986-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:24.249335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.249115    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccc3cf53-d1df-44e6-a925-754767822986-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:24.451605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.451576    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:20:24.455202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:24.455179    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-57a4f2d1-585d64f755-x8xxm"]
Sep 17 23:20:25.660988 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:25.660949    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc3cf53-d1df-44e6-a925-754767822986" path="/var/lib/kubelet/pods/ccc3cf53-d1df-44e6-a925-754767822986/volumes"
Sep 17 23:20:26.644356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:26.644316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:20:27.123365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:27.123329    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:20:29.438245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.438219    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:20:29.508503 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508396    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508503 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmxhh\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508554    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508587    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.508752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.509136 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.508803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs\") pod \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\" (UID: \"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b\") "
Sep 17 23:20:29.509413 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.509385    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:20:29.509614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.509403    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:20:29.509712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.509686    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:20:29.509787 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.509491    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data" (OuterVolumeSpecName: "istio-data") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:20:29.510194 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.510170    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:20:29.511559 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.511537    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:20:29.511658 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.511610    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:20:29.511712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.511693    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:20:29.512866 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.512844    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh" (OuterVolumeSpecName: "kube-api-access-jmxhh") pod "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" (UID: "4177c9ad-5b57-4b06-ba22-4d94dfee3b4b"). InnerVolumeSpecName "kube-api-access-jmxhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:20:29.610650 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610608    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610650 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610642    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610650 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610655    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmxhh\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-kube-api-access-jmxhh\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610667    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610679    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610689    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610700    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610710    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:29.610906 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:29.610724    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:20:30.169578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.169545    2581 generic.go:356] "Generic (PLEG): container finished" podID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerID="5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7" exitCode=0
Sep 17 23:20:30.169805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.169608    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"
Sep 17 23:20:30.169805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.169631    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerDied","Data":"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"}
Sep 17 23:20:30.169805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.169698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f" event={"ID":"4177c9ad-5b57-4b06-ba22-4d94dfee3b4b","Type":"ContainerDied","Data":"fb33f7fc95c036737eaf1917c006b86f83836907e5597c95b59f9305633be985"}
Sep 17 23:20:30.169805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.169731    2581 scope.go:117] "RemoveContainer" containerID="5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"
Sep 17 23:20:30.179066 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.179037    2581 scope.go:117] "RemoveContainer" containerID="df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"
Sep 17 23:20:30.191070 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.189494    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:20:30.197068 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.194958    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-57a4f2d1-openshift-default-86c85b5c44-mrr2f"]
Sep 17 23:20:30.211848 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.211822    2581 scope.go:117] "RemoveContainer" containerID="5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"
Sep 17 23:20:30.212271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:20:30.212246    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7\": container with ID starting with 5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7 not found: ID does not exist" containerID="5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"
Sep 17 23:20:30.212379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.212283    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7"} err="failed to get container status \"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7\": rpc error: code = NotFound desc = could not find container \"5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7\": container with ID starting with 5440e6465ca1fdaee5396f105db5a81efd1ec01468f79b64f3123574d32d07d7 not found: ID does not exist"
Sep 17 23:20:30.212379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.212311    2581 scope.go:117] "RemoveContainer" containerID="df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"
Sep 17 23:20:30.212638 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:20:30.212616    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162\": container with ID starting with df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162 not found: ID does not exist" containerID="df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"
Sep 17 23:20:30.212704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:30.212642    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162"} err="failed to get container status \"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162\": rpc error: code = NotFound desc = could not find container \"df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162\": container with ID starting with df200b73314fe91493fdc0191d14f137f2a6c741c4c2e46c1456b5c338795162 not found: ID does not exist"
Sep 17 23:20:31.661245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:31.661208    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" path="/var/lib/kubelet/pods/4177c9ad-5b57-4b06-ba22-4d94dfee3b4b/volumes"
Sep 17 23:20:37.213203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.213128    2581 generic.go:356] "Generic (PLEG): container finished" podID="37940560-e3dc-428a-a982-5783f5990f5a" containerID="fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541" exitCode=0
Sep 17 23:20:37.213630 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.213204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerDied","Data":"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"}
Sep 17 23:20:37.213696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.213633    2581 scope.go:117] "RemoveContainer" containerID="fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"
Sep 17 23:20:37.214819 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.214792    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:37.214882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.214865    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:37.214917 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:37.214899    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:20:38.220292 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:38.220258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerStarted","Data":"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"}
Sep 17 23:20:39.158652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:39.158608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:39.159725 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:39.159694    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:20:39.159867 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:39.159767    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 17 23:20:40.158055 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:40.158011    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:20:40.158431 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:40.158088    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 17 23:20:41.158067 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:41.158015    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:20:41.158433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:41.158089    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 17 23:20:42.044168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:42.044136    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:42.157965 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:42.157929    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:20:42.158167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:42.157986    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 17 23:20:43.157812 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:43.157773    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 17 23:20:43.157982 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:43.157843    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 17 23:20:44.162319 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:44.162292    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:44.163537 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:44.163514    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:20:46.139907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:46.139873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:20:59.745744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:20:59.745660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:21:01.614361 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:01.614335    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:21:01.614768 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:01.614516    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:21:16.700034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:16.699999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:21:32.140390 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:32.140350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:21:53.354475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:53.354437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:21:59.705692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.705653    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:21:59.706315 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706293    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc3cf53-d1df-44e6-a925-754767822986" containerName="maas-api"
Sep 17 23:21:59.706315 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706316    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc3cf53-d1df-44e6-a925-754767822986" containerName="maas-api"
Sep 17 23:21:59.706480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706344    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:21:59.706480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706354    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:21:59.706480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706465    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:21:59.706480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.706477    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc3cf53-d1df-44e6-a925-754767822986" containerName="maas-api"
Sep 17 23:21:59.710022 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.709998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.712679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.712654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-700887b8-openshift-default-dockercfg-5bshv\""
Sep 17 23:21:59.721187 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.721151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:21:59.871442 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871736 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871772 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871772 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.871842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.871793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4dkj\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.972944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.972850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.972944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.972897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.972944 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.972927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.972968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973281    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4dkj\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973631 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973691 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.973856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.973802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.975524 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.975502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.975637 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.975602    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.982243 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.982222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:21:59.982864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:21:59.982834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4dkj\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj\") pod \"e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") " pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:00.023847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.023812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:00.357463 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.357436    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:22:00.359872 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:22:00.359843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53a81e6_df55_4567_ac57_0e589c2dcfd3.slice/crio-0b22841802b7668e78a0e9c8d602532a9929315e08f70794c00da8382028c8ed WatchSource:0}: Error finding container 0b22841802b7668e78a0e9c8d602532a9929315e08f70794c00da8382028c8ed: Status 404 returned error can't find the container with id 0b22841802b7668e78a0e9c8d602532a9929315e08f70794c00da8382028c8ed
Sep 17 23:22:00.362262 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.362230    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:00.362356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.362294    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:00.362356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.362322    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:00.641480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.641386    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerStarted","Data":"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"}
Sep 17 23:22:00.641480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.641449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerStarted","Data":"0b22841802b7668e78a0e9c8d602532a9929315e08f70794c00da8382028c8ed"}
Sep 17 23:22:00.669212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:00.669142    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podStartSLOduration=1.6691192670000001 podStartE2EDuration="1.669119267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:21:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:22:00.666638388 +0000 UTC m=+959.545153636" watchObservedRunningTime="2026-09-17 23:22:00.669119267 +0000 UTC m=+959.547634513"
Sep 17 23:22:01.023981 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.023942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:01.029397 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.029368    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:01.346706 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.346630    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:22:01.346857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.346833    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" podUID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" containerName="maas-api" containerID="cri-o://b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d" gracePeriod=30
Sep 17 23:22:01.611920 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.611853    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:22:01.648685 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.648649    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" containerID="b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d" exitCode=0
Sep 17 23:22:01.648851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.648693    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"
Sep 17 23:22:01.648851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.648727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" event={"ID":"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5","Type":"ContainerDied","Data":"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"}
Sep 17 23:22:01.648851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.648786    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j" event={"ID":"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5","Type":"ContainerDied","Data":"37372ae0cd3a70bc5987356801920a122305833a0ab9a454ac19615096897b2c"}
Sep 17 23:22:01.648851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.648812    2581 scope.go:117] "RemoveContainer" containerID="b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"
Sep 17 23:22:01.649171 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.649155    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:01.650127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.650114    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:01.660976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.660959    2581 scope.go:117] "RemoveContainer" containerID="b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"
Sep 17 23:22:01.661299 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:01.661279    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d\": container with ID starting with b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d not found: ID does not exist" containerID="b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"
Sep 17 23:22:01.661402 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.661307    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d"} err="failed to get container status \"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d\": rpc error: code = NotFound desc = could not find container \"b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d\": container with ID starting with b815d2c60421b32bcbc08f8bc34d93aabfdd64a1de4f5b1a7d174dfa4ed9ae0d not found: ID does not exist"
Sep 17 23:22:01.690734 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.690701    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs\") pod \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") "
Sep 17 23:22:01.690878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.690774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca\") pod \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") "
Sep 17 23:22:01.690878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.690795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") pod \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") "
Sep 17 23:22:01.690878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.690839    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2clsh\" (UniqueName: \"kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh\") pod \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\" (UID: \"5ccaa123-fb38-421a-86b1-93d1d6a6a4e5\") "
Sep 17 23:22:01.691218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.691191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" (UID: "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:22:01.693335 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.693305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh" (OuterVolumeSpecName: "kube-api-access-2clsh") pod "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" (UID: "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5"). InnerVolumeSpecName "kube-api-access-2clsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:01.693460 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.693341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" (UID: "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:22:01.693524 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.693505    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" (UID: "5ccaa123-fb38-421a-86b1-93d1d6a6a4e5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:22:01.792178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.792141    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:01.792178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.792177    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:01.792178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.792194    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2clsh\" (UniqueName: \"kubernetes.io/projected/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-kube-api-access-2clsh\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:01.792480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.792207    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:01.968461 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.968428    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:22:01.970480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:01.970456    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-f324fe-79d9cccb9d-5tn6j"]
Sep 17 23:22:03.661439 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:03.661407    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" path="/var/lib/kubelet/pods/5ccaa123-fb38-421a-86b1-93d1d6a6a4e5/volumes"
Sep 17 23:22:10.613941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.613903    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:10.614486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614437    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:22:10.614486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614457    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:22:10.614621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614487    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" containerName="maas-api"
Sep 17 23:22:10.614621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614499    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" containerName="maas-api"
Sep 17 23:22:10.614621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614615    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ccaa123-fb38-421a-86b1-93d1d6a6a4e5" containerName="maas-api"
Sep 17 23:22:10.614781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.614632    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4177c9ad-5b57-4b06-ba22-4d94dfee3b4b" containerName="istio-proxy"
Sep 17 23:22:10.619505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.619481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.622033 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.622013    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-700887b8-serving-cert\""
Sep 17 23:22:10.631152 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.631116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:10.777836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.777801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.777836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.777840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.778116 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.777990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.778116 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.778032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87vq\" (UniqueName: \"kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.879236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.879134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.879236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.879194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87vq\" (UniqueName: \"kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.879491 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.879253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.879491 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.879278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.879491 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:10.879296    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-serving-cert: secret "maas-api-e2e-mt-700887b8-serving-cert" not found
Sep 17 23:22:10.879491 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:10.879365    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls podName:61e42f05-a4aa-4d22-bcff-6ee2cda4541c nodeName:}" failed. No retries permitted until 2026-09-17 23:22:11.379343945 +0000 UTC m=+970.257859193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls") pod "maas-api-e2e-mt-700887b8-6479b4c979-78pzt" (UID: "61e42f05-a4aa-4d22-bcff-6ee2cda4541c") : secret "maas-api-e2e-mt-700887b8-serving-cert" not found
Sep 17 23:22:10.879888 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.879866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.881715 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.881689    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:10.892521 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:10.892486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87vq\" (UniqueName: \"kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:11.384433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:11.384391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:11.386762 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:11.386733    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") pod \"maas-api-e2e-mt-700887b8-6479b4c979-78pzt\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:11.532118 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:11.532074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:11.808869 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:11.808844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:11.810760 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:22:11.810730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e42f05_a4aa_4d22_bcff_6ee2cda4541c.slice/crio-80b44564a279e6fe71dd2137097b46681f9c9a33122d4090de28216fad95bb68 WatchSource:0}: Error finding container 80b44564a279e6fe71dd2137097b46681f9c9a33122d4090de28216fad95bb68: Status 404 returned error can't find the container with id 80b44564a279e6fe71dd2137097b46681f9c9a33122d4090de28216fad95bb68
Sep 17 23:22:12.705770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:12.705733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" event={"ID":"61e42f05-a4aa-4d22-bcff-6ee2cda4541c","Type":"ContainerStarted","Data":"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"}
Sep 17 23:22:12.705930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:12.705791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" event={"ID":"61e42f05-a4aa-4d22-bcff-6ee2cda4541c","Type":"ContainerStarted","Data":"80b44564a279e6fe71dd2137097b46681f9c9a33122d4090de28216fad95bb68"}
Sep 17 23:22:12.705930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:12.705876    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:12.725267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:12.725220    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" podStartSLOduration=2.288143495 podStartE2EDuration="2.725204372s" totalImagesPullingTime="437.060877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:22:12.723901346 +0000 UTC m=+971.602416591" watchObservedRunningTime="2026-09-17 23:22:12.725204372 +0000 UTC m=+971.603719617"
Sep 17 23:22:18.717121 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:18.717090    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:25.143280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:25.143200    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:22:27.760830 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:27.760794    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:22:27.762021 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:27.761963    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" containerID="cri-o://2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0" gracePeriod=30
Sep 17 23:22:28.467413 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.467371    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:22:28.473088 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.473065    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.475693 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.475665    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-b6f859-openshift-default-dockercfg-tk4mr\""
Sep 17 23:22:28.503415 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.503367    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:22:28.540274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wkf\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540479 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.540652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.540608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641298 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641298 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wkf\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.641921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.641896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.642199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.642166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.642513 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.642493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.643856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.643830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.644141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.644117    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.650035 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.650016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wkf\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.650344 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.650328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token\") pod \"e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") " pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:28.796986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:28.796883    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:29.080419 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.080373    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:22:29.082762 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:22:29.082723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d17446b_bb2e_4b17_b777_2955f7e89e24.slice/crio-65fea7966314727e1a846ceed2eb151b86ce51573b6d8e2c42b04a5fdb9866be WatchSource:0}: Error finding container 65fea7966314727e1a846ceed2eb151b86ce51573b6d8e2c42b04a5fdb9866be: Status 404 returned error can't find the container with id 65fea7966314727e1a846ceed2eb151b86ce51573b6d8e2c42b04a5fdb9866be
Sep 17 23:22:29.091793 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.091739    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:29.091923 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.091835    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:29.091923 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.091878    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:29.164449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.164424    2581 patch_prober.go:28] interesting pod/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:22:29.164561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.164493    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:22:29.800111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.800067    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" event={"ID":"8d17446b-bb2e-4b17-b777-2955f7e89e24","Type":"ContainerStarted","Data":"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"}
Sep 17 23:22:29.800620 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.800140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" event={"ID":"8d17446b-bb2e-4b17-b777-2955f7e89e24","Type":"ContainerStarted","Data":"65fea7966314727e1a846ceed2eb151b86ce51573b6d8e2c42b04a5fdb9866be"}
Sep 17 23:22:29.820941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:29.820890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" podStartSLOduration=1.820872909 podStartE2EDuration="1.820872909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:22:29.819893693 +0000 UTC m=+988.698408939" watchObservedRunningTime="2026-09-17 23:22:29.820872909 +0000 UTC m=+988.699388155"
Sep 17 23:22:30.797818 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:30.797782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:30.809106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:30.809079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:31.812354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:31.812319    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:31.813476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:31.813450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:22:33.069462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.069432    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:22:33.197511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqsf8\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197559    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197587    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197637    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197688    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197749    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket\") pod \"37940560-e3dc-428a-a982-5783f5990f5a\" (UID: \"37940560-e3dc-428a-a982-5783f5990f5a\") "
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197850    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data" (OuterVolumeSpecName: "istio-data") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:33.197899 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.197887    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198174    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198220    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198244    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198260    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.198280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.198274    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37940560-e3dc-428a-a982-5783f5990f5a-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.200080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.200014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:22:33.200283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.200263    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8" (OuterVolumeSpecName: "kube-api-access-mqsf8") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "kube-api-access-mqsf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:33.201340 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.201319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token" (OuterVolumeSpecName: "istio-token") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:33.201444 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.201431    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "37940560-e3dc-428a-a982-5783f5990f5a" (UID: "37940560-e3dc-428a-a982-5783f5990f5a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:22:33.299505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.299438    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqsf8\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-kube-api-access-mqsf8\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.299505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.299466    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.299505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.299476    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37940560-e3dc-428a-a982-5783f5990f5a-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.299505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.299484    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37940560-e3dc-428a-a982-5783f5990f5a-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.299505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.299492    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37940560-e3dc-428a-a982-5783f5990f5a-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:33.823740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.823692    2581 generic.go:356] "Generic (PLEG): container finished" podID="37940560-e3dc-428a-a982-5783f5990f5a" containerID="2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0" exitCode=0
Sep 17 23:22:33.823740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.823743    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"
Sep 17 23:22:33.823979 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.823730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerDied","Data":"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"}
Sep 17 23:22:33.823979 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.823876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5" event={"ID":"37940560-e3dc-428a-a982-5783f5990f5a","Type":"ContainerDied","Data":"079b3c1972d135ba79c47fe7bd25421b6b599d99851d78535d55199aa63be0c5"}
Sep 17 23:22:33.823979 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.823910    2581 scope.go:117] "RemoveContainer" containerID="2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"
Sep 17 23:22:33.834485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.834469    2581 scope.go:117] "RemoveContainer" containerID="fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"
Sep 17 23:22:33.843163 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.843143    2581 scope.go:117] "RemoveContainer" containerID="2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"
Sep 17 23:22:33.843518 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:33.843496    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0\": container with ID starting with 2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0 not found: ID does not exist" containerID="2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"
Sep 17 23:22:33.843598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.843527    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0"} err="failed to get container status \"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0\": rpc error: code = NotFound desc = could not find container \"2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0\": container with ID starting with 2cfd6f9be6c6ce5a9aa6d8280e0bb6797dfdb0bf22948959679a4cd0795f69f0 not found: ID does not exist"
Sep 17 23:22:33.843598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.843545    2581 scope.go:117] "RemoveContainer" containerID="fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"
Sep 17 23:22:33.843831 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:33.843815    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541\": container with ID starting with fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541 not found: ID does not exist" containerID="fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"
Sep 17 23:22:33.843893 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.843836    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541"} err="failed to get container status \"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541\": rpc error: code = NotFound desc = could not find container \"fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541\": container with ID starting with fbec072046f09b0dec8476be2b51671aa8e3f638b5efa67cfc2c7e9dad02f541 not found: ID does not exist"
Sep 17 23:22:33.844396 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.844373    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:22:33.848767 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:33.848746    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f324fe-openshift-default-854bc57c6d-d5rv5"]
Sep 17 23:22:35.661541 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:35.661510    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37940560-e3dc-428a-a982-5783f5990f5a" path="/var/lib/kubelet/pods/37940560-e3dc-428a-a982-5783f5990f5a/volumes"
Sep 17 23:22:36.841453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.841418    2581 generic.go:356] "Generic (PLEG): container finished" podID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerID="2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719" exitCode=0
Sep 17 23:22:36.841453 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.841458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerDied","Data":"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"}
Sep 17 23:22:36.841902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.841829    2581 scope.go:117] "RemoveContainer" containerID="2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"
Sep 17 23:22:36.843015 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.842989    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:36.843144 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.843126    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:36.843189 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:36.843168    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:22:37.848542 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:37.848506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerStarted","Data":"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"}
Sep 17 23:22:38.024269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:38.024230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:38.024452 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:38.024430    2581 patch_prober.go:28] interesting pod/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 17 23:22:38.024497 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:38.024481    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 17 23:22:39.024278 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:39.024240    2581 patch_prober.go:28] interesting pod/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 17 23:22:39.024760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:39.024302    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 17 23:22:40.025013 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:40.024971    2581 patch_prober.go:28] interesting pod/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 17 23:22:40.025454 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:40.025039    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 17 23:22:41.024915 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:41.024872    2581 patch_prober.go:28] interesting pod/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 17 23:22:41.025151 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:41.024948    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 17 23:22:42.024394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:42.024359    2581 patch_prober.go:28] interesting pod/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 17 23:22:42.024590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:42.024418    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 17 23:22:43.028718 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:43.028687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:43.029208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:43.029190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:43.029952 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:43.029934    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:22:50.849764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:50.849724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:22:53.888876 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:53.888834    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:53.889359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:53.889111    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" podUID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" containerName="maas-api" containerID="cri-o://4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782" gracePeriod=30
Sep 17 23:22:54.156090 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.156061    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:54.211562 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.211532    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs\") pod \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") "
Sep 17 23:22:54.211758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.211631    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") pod \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") "
Sep 17 23:22:54.211758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.211676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b87vq\" (UniqueName: \"kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq\") pod \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") "
Sep 17 23:22:54.211758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.211726    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca\") pod \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\" (UID: \"61e42f05-a4aa-4d22-bcff-6ee2cda4541c\") "
Sep 17 23:22:54.212198 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.212167    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "61e42f05-a4aa-4d22-bcff-6ee2cda4541c" (UID: "61e42f05-a4aa-4d22-bcff-6ee2cda4541c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:22:54.213691 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.213672    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "61e42f05-a4aa-4d22-bcff-6ee2cda4541c" (UID: "61e42f05-a4aa-4d22-bcff-6ee2cda4541c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:22:54.214264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.214241    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "61e42f05-a4aa-4d22-bcff-6ee2cda4541c" (UID: "61e42f05-a4aa-4d22-bcff-6ee2cda4541c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:22:54.214264 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.214255    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq" (OuterVolumeSpecName: "kube-api-access-b87vq") pod "61e42f05-a4aa-4d22-bcff-6ee2cda4541c" (UID: "61e42f05-a4aa-4d22-bcff-6ee2cda4541c"). InnerVolumeSpecName "kube-api-access-b87vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:22:54.313623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.313585    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b87vq\" (UniqueName: \"kubernetes.io/projected/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-kube-api-access-b87vq\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:54.313623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.313623    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:54.313836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.313636    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:54.313836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.313648    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/61e42f05-a4aa-4d22-bcff-6ee2cda4541c-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:22:54.941998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.941965    2581 generic.go:356] "Generic (PLEG): container finished" podID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" containerID="4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782" exitCode=0
Sep 17 23:22:54.942498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.942018    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"
Sep 17 23:22:54.942498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.942063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" event={"ID":"61e42f05-a4aa-4d22-bcff-6ee2cda4541c","Type":"ContainerDied","Data":"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"}
Sep 17 23:22:54.942498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.942114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt" event={"ID":"61e42f05-a4aa-4d22-bcff-6ee2cda4541c","Type":"ContainerDied","Data":"80b44564a279e6fe71dd2137097b46681f9c9a33122d4090de28216fad95bb68"}
Sep 17 23:22:54.942498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.942136    2581 scope.go:117] "RemoveContainer" containerID="4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"
Sep 17 23:22:54.951408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.951386    2581 scope.go:117] "RemoveContainer" containerID="4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"
Sep 17 23:22:54.951660 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:22:54.951642    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782\": container with ID starting with 4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782 not found: ID does not exist" containerID="4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"
Sep 17 23:22:54.951698 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.951670    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782"} err="failed to get container status \"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782\": rpc error: code = NotFound desc = could not find container \"4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782\": container with ID starting with 4c269db19e5403456ecef63da419c83e8d0e5b66093fb8ecf7c32e2703baf782 not found: ID does not exist"
Sep 17 23:22:54.963084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.963060    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:54.965348 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:54.965330    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-700887b8-6479b4c979-78pzt"]
Sep 17 23:22:55.661401 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:22:55.661364    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" path="/var/lib/kubelet/pods/61e42f05-a4aa-4d22-bcff-6ee2cda4541c/volumes"
Sep 17 23:23:00.442808 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:00.442774    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:23:00.443297 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:00.442972    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy" containerID="cri-o://14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5" gracePeriod=30
Sep 17 23:23:05.712484 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.712421    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:23:05.826630 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826659    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.826817 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826815    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.827184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.827184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4dkj\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj\") pod \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\" (UID: \"e53a81e6-df55-4567-ac57-0e589c2dcfd3\") "
Sep 17 23:23:05.827184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.826999    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:05.827184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827040    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:05.827378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827284    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:23:05.827378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827299    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:05.827378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827312    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.827378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827332    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.827558 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.827374    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:05.829040 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.829016    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:23:05.829141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.829105    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj" (OuterVolumeSpecName: "kube-api-access-l4dkj") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "kube-api-access-l4dkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:23:05.829342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.829317    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:23:05.829436 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.829341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e53a81e6-df55-4567-ac57-0e589c2dcfd3" (UID: "e53a81e6-df55-4567-ac57-0e589c2dcfd3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:05.928173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928141    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928166    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928175    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928183    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928192    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e53a81e6-df55-4567-ac57-0e589c2dcfd3-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928200    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e53a81e6-df55-4567-ac57-0e589c2dcfd3-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:05.928398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:05.928207    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4dkj\" (UniqueName: \"kubernetes.io/projected/e53a81e6-df55-4567-ac57-0e589c2dcfd3-kube-api-access-l4dkj\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:06.002882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.002795    2581 generic.go:356] "Generic (PLEG): container finished" podID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerID="14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5" exitCode=0
Sep 17 23:23:06.002882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.002862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerDied","Data":"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"}
Sep 17 23:23:06.003077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.002903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv" event={"ID":"e53a81e6-df55-4567-ac57-0e589c2dcfd3","Type":"ContainerDied","Data":"0b22841802b7668e78a0e9c8d602532a9929315e08f70794c00da8382028c8ed"}
Sep 17 23:23:06.003077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.002924    2581 scope.go:117] "RemoveContainer" containerID="14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"
Sep 17 23:23:06.003077 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.002842    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"
Sep 17 23:23:06.012785 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.012767    2581 scope.go:117] "RemoveContainer" containerID="2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"
Sep 17 23:23:06.022984 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.022964    2581 scope.go:117] "RemoveContainer" containerID="14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"
Sep 17 23:23:06.023526 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:23:06.023504    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5\": container with ID starting with 14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5 not found: ID does not exist" containerID="14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"
Sep 17 23:23:06.023596 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.023534    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5"} err="failed to get container status \"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5\": rpc error: code = NotFound desc = could not find container \"14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5\": container with ID starting with 14f12a46abfce013972da7d01a8e3a91d73efedc1556e64eb6eaf1dfe3fd7ca5 not found: ID does not exist"
Sep 17 23:23:06.023596 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.023551    2581 scope.go:117] "RemoveContainer" containerID="2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"
Sep 17 23:23:06.023837 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:23:06.023818    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719\": container with ID starting with 2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719 not found: ID does not exist" containerID="2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"
Sep 17 23:23:06.023870 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.023842    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719"} err="failed to get container status \"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719\": rpc error: code = NotFound desc = could not find container \"2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719\": container with ID starting with 2f7ddc8660e8614fd95906bb92fe775bed1e7eea0ca8bc7728c0a3672b2e4719 not found: ID does not exist"
Sep 17 23:23:06.027598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.027578    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:23:06.031363 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:06.031343    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-700887b8-openshift-default-5b6464f868-4t5cv"]
Sep 17 23:23:07.661655 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:07.661626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" path="/var/lib/kubelet/pods/e53a81e6-df55-4567-ac57-0e589c2dcfd3/volumes"
Sep 17 23:23:11.758251 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758218    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:23:11.758626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758611    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758621    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758630    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758636    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758646    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758652    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758668    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758673    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758680    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" containerName="maas-api"
Sep 17 23:23:11.758699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758685    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" containerName="maas-api"
Sep 17 23:23:11.758956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758743    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758751    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:11.758956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758759    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53a81e6-df55-4567-ac57-0e589c2dcfd3" containerName="istio-proxy"
Sep 17 23:23:11.758956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.758765    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e42f05-a4aa-4d22-bcff-6ee2cda4541c" containerName="maas-api"
Sep 17 23:23:11.763189 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.763169    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.766462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.766437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0b4d93\"/\"openshift-service-ca.crt\""
Sep 17 23:23:11.766588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.766475    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0b4d93\"/\"default-dockercfg-fzhhg\""
Sep 17 23:23:11.766588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.766501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-0b4d93\"/\"kube-root-ca.crt\""
Sep 17 23:23:11.766588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.766475    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-0b4d93\"/\"distinct-w0-0b4d93-kserve-self-signed-certs\""
Sep 17 23:23:11.771949 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.771927    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:23:11.886443 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.886443 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.886644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.886644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9w9\" (UniqueName: \"kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.886644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.886644 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.886579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.986973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987128    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9w9\" (UniqueName: \"kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987513 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987576 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.987576 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.987553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.989345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.989324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.989657 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.989639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:11.995347 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:11.995329    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9w9\" (UniqueName: \"kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9\") pod \"distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") " pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:12.073302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:12.073222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:12.346065 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:12.346024    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:23:12.348482 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:12.348458    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd94343a0_a04f_444f_8b71_74d444616218.slice/crio-0cda87c69c8bfed6b9d281c01217ff3b07154649cda1ede40a63f542b72498b7 WatchSource:0}: Error finding container 0cda87c69c8bfed6b9d281c01217ff3b07154649cda1ede40a63f542b72498b7: Status 404 returned error can't find the container with id 0cda87c69c8bfed6b9d281c01217ff3b07154649cda1ede40a63f542b72498b7
Sep 17 23:23:13.040973 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:13.040943    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" event={"ID":"d94343a0-a04f-444f-8b71-74d444616218","Type":"ContainerStarted","Data":"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"}
Sep 17 23:23:13.041408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:13.040984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" event={"ID":"d94343a0-a04f-444f-8b71-74d444616218","Type":"ContainerStarted","Data":"0cda87c69c8bfed6b9d281c01217ff3b07154649cda1ede40a63f542b72498b7"}
Sep 17 23:23:13.059589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:13.059537    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" podStartSLOduration=2.059520939 podStartE2EDuration="2.059520939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:13.058215183 +0000 UTC m=+1031.936730429" watchObservedRunningTime="2026-09-17 23:23:13.059520939 +0000 UTC m=+1031.938036185"
Sep 17 23:23:13.943136 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:13.943100    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:23:14.560832 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.560796    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:23:14.561333 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.561318    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="37940560-e3dc-428a-a982-5783f5990f5a" containerName="istio-proxy"
Sep 17 23:23:14.564658 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.564643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.567159 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.567135    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-09c1c1-openshift-default-dockercfg-8bs76\""
Sep 17 23:23:14.582245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.582221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:23:14.714036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714003    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714113    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqwvk\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.714371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.714336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815193 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqwvk\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815836    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.815916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.815882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.816189 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.816137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.816351 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.816330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.817873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.817848    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.817951 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.817910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.824322 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.824291    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.824436 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.824402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqwvk\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk\") pod \"e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") " pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:14.875387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:14.875362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:15.155344 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:15.155315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:23:15.156527 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:15.156498    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfc1285_69d8_4e0c_a661_c7af6e671e0a.slice/crio-d88ad8e05011aea0525d17be01aa67b5f190ea4ab0778520929896a1e5af950c WatchSource:0}: Error finding container d88ad8e05011aea0525d17be01aa67b5f190ea4ab0778520929896a1e5af950c: Status 404 returned error can't find the container with id d88ad8e05011aea0525d17be01aa67b5f190ea4ab0778520929896a1e5af950c
Sep 17 23:23:15.158757 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:15.158723    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:15.158831 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:15.158789    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:15.158831 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:15.158821    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:16.058153 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:16.058116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerStarted","Data":"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"}
Sep 17 23:23:16.058533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:16.058178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerStarted","Data":"d88ad8e05011aea0525d17be01aa67b5f190ea4ab0778520929896a1e5af950c"}
Sep 17 23:23:16.080287 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:16.080229    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podStartSLOduration=2.080209303 podStartE2EDuration="2.080209303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:16.077575702 +0000 UTC m=+1034.956090963" watchObservedRunningTime="2026-09-17 23:23:16.080209303 +0000 UTC m=+1034.958724553"
Sep 17 23:23:16.875803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:16.875768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:16.881061 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:16.881022    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:17.063026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:17.062984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:17.063989 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:17.063965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:21.265639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.265601    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:23:21.269611 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.269591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.272184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.272153    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-09c1c1-serving-cert\""
Sep 17 23:23:21.279376 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.279345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:23:21.384882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.384840    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.385082 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.384908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n68d5\" (UniqueName: \"kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.385082 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.384973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.385082 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.385032    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.486443 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.486401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.486792 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.486481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n68d5\" (UniqueName: \"kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.486792 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.486513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.486792 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.486544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.487370 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.487339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.489738 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.489716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.489848 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.489718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.494984 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.494960    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n68d5\" (UniqueName: \"kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5\") pod \"maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.585224 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.585135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:21.862101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.862074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:23:21.864331 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:21.864293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ab2514_a5ad_4bb8_bee6_803f30a806ba.slice/crio-eb0859229f777a9db4845c76fb72e301be6a1342e6386c6129ad2059717be1ed WatchSource:0}: Error finding container eb0859229f777a9db4845c76fb72e301be6a1342e6386c6129ad2059717be1ed: Status 404 returned error can't find the container with id eb0859229f777a9db4845c76fb72e301be6a1342e6386c6129ad2059717be1ed
Sep 17 23:23:21.865882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:21.865865    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:23:22.073537 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:22.073501    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:22.073717 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:22.073560    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:22.088843 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:22.088820    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:22.090034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:22.090002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" event={"ID":"e7ab2514-a5ad-4bb8-bee6-803f30a806ba","Type":"ContainerStarted","Data":"eb0859229f777a9db4845c76fb72e301be6a1342e6386c6129ad2059717be1ed"}
Sep 17 23:23:22.101794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:22.101766    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:23:23.097216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:23.097179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" event={"ID":"e7ab2514-a5ad-4bb8-bee6-803f30a806ba","Type":"ContainerStarted","Data":"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"}
Sep 17 23:23:23.097685 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:23.097275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:23.116221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:23.116172    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" podStartSLOduration=1.677695658 podStartE2EDuration="2.116156504s" totalImagesPullingTime="438.460846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:23.11384124 +0000 UTC m=+1041.992356490" watchObservedRunningTime="2026-09-17 23:23:23.116156504 +0000 UTC m=+1041.994671750"
Sep 17 23:23:29.109213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:29.109180    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:23:38.239317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:38.239285    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:23:38.239811 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:38.239523    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" podUID="8d17446b-bb2e-4b17-b777-2955f7e89e24" containerName="istio-proxy" containerID="cri-o://5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645" gracePeriod=30
Sep 17 23:23:43.503849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.503789    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:23:43.598362 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598331    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2wkf\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598513    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598536    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598677    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket\") pod \"8d17446b-bb2e-4b17-b777-2955f7e89e24\" (UID: \"8d17446b-bb2e-4b17-b777-2955f7e89e24\") "
Sep 17 23:23:43.598796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598718    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:43.598796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598786    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:23:43.599078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598886    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:43.599078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598697    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:43.599078 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.598921    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:43.599241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.599103    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.599241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.599116    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.599241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.599125    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d17446b-bb2e-4b17-b777-2955f7e89e24-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.599241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.599134    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.599241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.599142    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.600756 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.600733    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf" (OuterVolumeSpecName: "kube-api-access-p2wkf") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "kube-api-access-p2wkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:23:43.600839 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.600789    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:23:43.601071 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.601030    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:23:43.601170 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.601068    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d17446b-bb2e-4b17-b777-2955f7e89e24" (UID: "8d17446b-bb2e-4b17-b777-2955f7e89e24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:23:43.700428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.700397    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2wkf\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-kube-api-access-p2wkf\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.700428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.700425    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.700428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.700434    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:43.700627 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:43.700441    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d17446b-bb2e-4b17-b777-2955f7e89e24-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:23:44.211632 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.211597    2581 generic.go:356] "Generic (PLEG): container finished" podID="8d17446b-bb2e-4b17-b777-2955f7e89e24" containerID="5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645" exitCode=0
Sep 17 23:23:44.211829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.211662    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"
Sep 17 23:23:44.211829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.211683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" event={"ID":"8d17446b-bb2e-4b17-b777-2955f7e89e24","Type":"ContainerDied","Data":"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"}
Sep 17 23:23:44.211829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.211764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv" event={"ID":"8d17446b-bb2e-4b17-b777-2955f7e89e24","Type":"ContainerDied","Data":"65fea7966314727e1a846ceed2eb151b86ce51573b6d8e2c42b04a5fdb9866be"}
Sep 17 23:23:44.211829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.211788    2581 scope.go:117] "RemoveContainer" containerID="5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"
Sep 17 23:23:44.221302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.221285    2581 scope.go:117] "RemoveContainer" containerID="5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"
Sep 17 23:23:44.221552 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:23:44.221534    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645\": container with ID starting with 5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645 not found: ID does not exist" containerID="5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"
Sep 17 23:23:44.221595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.221560    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645"} err="failed to get container status \"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645\": rpc error: code = NotFound desc = could not find container \"5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645\": container with ID starting with 5a655db4819953b1990aeff7c2ca3003a8d223fd4bd21da95df3b3c29db37645 not found: ID does not exist"
Sep 17 23:23:44.230115 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.230095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:23:44.233958 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:44.233937    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-b6f859-openshift-default-6d787fd5bd-bd8xv"]
Sep 17 23:23:45.661727 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.661698    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d17446b-bb2e-4b17-b777-2955f7e89e24" path="/var/lib/kubelet/pods/8d17446b-bb2e-4b17-b777-2955f7e89e24/volumes"
Sep 17 23:23:45.662119 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.661980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:23:45.741712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.741680    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:23:45.742374 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.742356    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d17446b-bb2e-4b17-b777-2955f7e89e24" containerName="istio-proxy"
Sep 17 23:23:45.742432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.742377    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d17446b-bb2e-4b17-b777-2955f7e89e24" containerName="istio-proxy"
Sep 17 23:23:45.742522 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.742511    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d17446b-bb2e-4b17-b777-2955f7e89e24" containerName="istio-proxy"
Sep 17 23:23:45.747485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.747461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.750095 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.750069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7ab633\"/\"openshift-service-ca.crt\""
Sep 17 23:23:45.751529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.751157    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7ab633\"/\"e2e-conflict-b-21551ab9-kserve-self-signed-certs\""
Sep 17 23:23:45.751529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.751290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-7ab633\"/\"default-dockercfg-b9f5k\""
Sep 17 23:23:45.751795 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.751773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-7ab633\"/\"kube-root-ca.crt\""
Sep 17 23:23:45.754934 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.754913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:23:45.820865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.820829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.820865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.820866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.821152 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.820951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.821152 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.820983    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnxbq\" (UniqueName: \"kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.821152 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.821014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.821152 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.821100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.921779 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.921688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnxbq\" (UniqueName: \"kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.921779 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.921740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.921797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.921856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.921883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.922005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.922277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922381 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.922307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.922381 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.922348    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.924356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.924325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.924503 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.924486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:45.930332 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:45.930307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnxbq\" (UniqueName: \"kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq\") pod \"e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") " pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:46.058879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:46.058844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:46.333361 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:46.333337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:23:46.335057 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:46.335005    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcd4e2a2_52e2_4d0a_870c_d0f5fa719b0d.slice/crio-d991bfc6ca380f63537205bdf616d966a14a7fe1ee41c5f1966faad22f45325a WatchSource:0}: Error finding container d991bfc6ca380f63537205bdf616d966a14a7fe1ee41c5f1966faad22f45325a: Status 404 returned error can't find the container with id d991bfc6ca380f63537205bdf616d966a14a7fe1ee41c5f1966faad22f45325a
Sep 17 23:23:47.230651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:47.230614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" event={"ID":"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d","Type":"ContainerStarted","Data":"db7a0cc75e4c02ccefcf3350dcdeb858375111c225e16fddb91d57cad2261510"}
Sep 17 23:23:47.231079 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:47.230661    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" event={"ID":"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d","Type":"ContainerStarted","Data":"d991bfc6ca380f63537205bdf616d966a14a7fe1ee41c5f1966faad22f45325a"}
Sep 17 23:23:47.250364 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:47.250311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" podStartSLOduration=2.250295586 podStartE2EDuration="2.250295586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:47.247677792 +0000 UTC m=+1066.126193038" watchObservedRunningTime="2026-09-17 23:23:47.250295586 +0000 UTC m=+1066.128810832"
Sep 17 23:23:48.619106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.619031    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:23:48.623731 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.623706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.626603 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.626570    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-55130c-openshift-default-dockercfg-jfdrr\""
Sep 17 23:23:48.634704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.634676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:23:48.748686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.748686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.748912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.748912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.748912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.748912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748868    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.749112 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.749112 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.749112 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.748997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7f8\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.849989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7f8\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850570 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850570 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850566    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850880 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850844    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.850981 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.850957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.852838 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.852815    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.852970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.852953    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.858758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.858731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.858908 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.858891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7f8\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8\") pod \"e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") " pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:48.939427 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:48.939386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:49.249747 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:49.249722    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:23:49.251632 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:49.251606    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4344ed18_35c9_46d4_bc69_6b2dfe67e82a.slice/crio-4e1d3a87c63bec795708a6d3b165c00399a7b8c52691d8a88b0a03f426a023b0 WatchSource:0}: Error finding container 4e1d3a87c63bec795708a6d3b165c00399a7b8c52691d8a88b0a03f426a023b0: Status 404 returned error can't find the container with id 4e1d3a87c63bec795708a6d3b165c00399a7b8c52691d8a88b0a03f426a023b0
Sep 17 23:23:49.254167 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:49.254126    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:49.254280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:49.254212    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:49.254280 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:49.254251    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:50.249996 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:50.249953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerStarted","Data":"a96ee4fde9f4d325064ca4a294a411290211d5768793cc07a35cb8fe904632aa"}
Sep 17 23:23:50.250488 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:50.250066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerStarted","Data":"4e1d3a87c63bec795708a6d3b165c00399a7b8c52691d8a88b0a03f426a023b0"}
Sep 17 23:23:50.272720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:50.272664    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podStartSLOduration=2.272649286 podStartE2EDuration="2.272649286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:50.270445876 +0000 UTC m=+1069.148961121" watchObservedRunningTime="2026-09-17 23:23:50.272649286 +0000 UTC m=+1069.151164531"
Sep 17 23:23:50.940544 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:50.940504    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:50.945723 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:50.945695    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:51.254819 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:51.254741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:51.255635 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:51.255612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:23:55.931967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:55.931882    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:23:55.935684 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:55.935661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:55.937978 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:55.937954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-55130c-serving-cert\""
Sep 17 23:23:55.948058 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:55.948016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:23:56.031599 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.031560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.031765 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.031607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.031765 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.031652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwm5b\" (UniqueName: \"kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.031846 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.031763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.059379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.059347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:56.059552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.059411    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:56.072285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.072258    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:56.133029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.133000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.133219 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:23:56.133166    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-serving-cert: secret "maas-api-e2e-shared-b-w2-55130c-serving-cert" not found
Sep 17 23:23:56.133295 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:23:56.133227    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls podName:3bdaca07-64bf-47ae-b7ae-b57d43fde53d nodeName:}" failed. No retries permitted until 2026-09-17 23:23:56.63321152 +0000 UTC m=+1075.511726743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls") pod "maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" (UID: "3bdaca07-64bf-47ae-b7ae-b57d43fde53d") : secret "maas-api-e2e-shared-b-w2-55130c-serving-cert" not found
Sep 17 23:23:56.133295 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.133038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.133417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.133335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwm5b\" (UniqueName: \"kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.133475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.133462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.134168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.134143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.135630 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.135608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.143902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.143877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwm5b\" (UniqueName: \"kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.284273 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.284190    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerID="2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd" exitCode=0
Sep 17 23:23:56.284273 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.284257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerDied","Data":"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"}
Sep 17 23:23:56.284719 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.284701    2581 scope.go:117] "RemoveContainer" containerID="2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"
Sep 17 23:23:56.285915 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.285873    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:56.286030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.285974    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:56.286030 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.286019    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:23:56.296804 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.296785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:23:56.638722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.638645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.641029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.640995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:56.846941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:56.846905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:57.147351 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.147324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:23:57.149059 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:23:57.149020    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdaca07_64bf_47ae_b7ae_b57d43fde53d.slice/crio-003b1792c12f6bd0e6207a151bc03030799d7d494cdf8b43045a68eba9acfd60 WatchSource:0}: Error finding container 003b1792c12f6bd0e6207a151bc03030799d7d494cdf8b43045a68eba9acfd60: Status 404 returned error can't find the container with id 003b1792c12f6bd0e6207a151bc03030799d7d494cdf8b43045a68eba9acfd60
Sep 17 23:23:57.296350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.296244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerStarted","Data":"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"}
Sep 17 23:23:57.299107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.299070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" event={"ID":"3bdaca07-64bf-47ae-b7ae-b57d43fde53d","Type":"ContainerStarted","Data":"003b1792c12f6bd0e6207a151bc03030799d7d494cdf8b43045a68eba9acfd60"}
Sep 17 23:23:57.875907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.875832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:23:57.877085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.877030    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 17 23:23:57.877215 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:57.877106    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 17 23:23:58.309816 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:58.309774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" event={"ID":"3bdaca07-64bf-47ae-b7ae-b57d43fde53d","Type":"ContainerStarted","Data":"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"}
Sep 17 23:23:58.310440 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:58.310413    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:23:58.329353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:58.329307    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" podStartSLOduration=2.985789625 podStartE2EDuration="3.329291568s" totalImagesPullingTime="343.501943ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:23:58.327238673 +0000 UTC m=+1077.205753918" watchObservedRunningTime="2026-09-17 23:23:58.329291568 +0000 UTC m=+1077.207806813"
Sep 17 23:23:58.876518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:58.876487    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 17 23:23:58.876683 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:58.876552    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 17 23:23:59.876618 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:59.876581    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 17 23:23:59.877066 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:23:59.876634    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 17 23:24:00.876652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:00.876621    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 17 23:24:00.877004 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:00.876675    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 17 23:24:01.876714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:01.876679    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 17 23:24:01.877130 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:01.876736    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 17 23:24:02.063338 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:02.063257    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:24:02.879862 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:02.879832    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:24:02.880847 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:02.880825    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:24:04.321140 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:04.321108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:24:16.412900 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.412865    2581 generic.go:356] "Generic (PLEG): container finished" podID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerID="a96ee4fde9f4d325064ca4a294a411290211d5768793cc07a35cb8fe904632aa" exitCode=0
Sep 17 23:24:16.413348 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.412912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerDied","Data":"a96ee4fde9f4d325064ca4a294a411290211d5768793cc07a35cb8fe904632aa"}
Sep 17 23:24:16.413404 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.413351    2581 scope.go:117] "RemoveContainer" containerID="a96ee4fde9f4d325064ca4a294a411290211d5768793cc07a35cb8fe904632aa"
Sep 17 23:24:16.414580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.414551    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:24:16.414637 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.414624    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:24:16.414674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:16.414656    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:24:17.420386 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:17.420350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerStarted","Data":"743d925cab1ec489ef8706a52849f37c53245d878156183a0a72eb6d568b79b7"}
Sep 17 23:24:17.939885 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:17.939849    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:24:17.940933 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:17.940907    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 23:24:17.941080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:17.940958    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 23:24:18.940382 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:18.940343    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 23:24:18.940750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:18.940403    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 23:24:19.940209 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:19.940174    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 23:24:19.940398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:19.940234    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 23:24:20.940578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:20.940544    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 23:24:20.940957 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:20.940601    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 23:24:21.254749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:21.254650    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:24:21.939913 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:21.939877    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 17 23:24:21.940104 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:21.939940    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 17 23:24:22.944500 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.944468    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-a4ed49"]
Sep 17 23:24:22.948217 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.948196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:24:22.948342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.948271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:22.949157 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.949136    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:24:22.950958 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.950938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8nhtg\""
Sep 17 23:24:22.954222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:22.954201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-a4ed49"]
Sep 17 23:24:23.030892 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:23.030852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wz4t\" (UniqueName: \"kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t\") pod \"test-curl-7635-a4ed49\" (UID: \"bddf4286-26d8-4387-99b0-b73518070513\") " pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:23.132441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:23.132408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wz4t\" (UniqueName: \"kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t\") pod \"test-curl-7635-a4ed49\" (UID: \"bddf4286-26d8-4387-99b0-b73518070513\") " pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:23.142526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:23.142498    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wz4t\" (UniqueName: \"kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t\") pod \"test-curl-7635-a4ed49\" (UID: \"bddf4286-26d8-4387-99b0-b73518070513\") " pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:23.259975 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:23.259881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:23.530962 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:23.530931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-a4ed49"]
Sep 17 23:24:23.533258 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:24:23.533234    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbddf4286_26d8_4387_99b0_b73518070513.slice/crio-3e844594a9f07586effb8ea13b6fce6f9629a5b3b326d12ea705ee6c689b54cb WatchSource:0}: Error finding container 3e844594a9f07586effb8ea13b6fce6f9629a5b3b326d12ea705ee6c689b54cb: Status 404 returned error can't find the container with id 3e844594a9f07586effb8ea13b6fce6f9629a5b3b326d12ea705ee6c689b54cb
Sep 17 23:24:24.149141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:24.149101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:24:24.460266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:24.460231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-a4ed49" event={"ID":"bddf4286-26d8-4387-99b0-b73518070513","Type":"ContainerStarted","Data":"1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed"}
Sep 17 23:24:24.460449 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:24.460281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-a4ed49" event={"ID":"bddf4286-26d8-4387-99b0-b73518070513","Type":"ContainerStarted","Data":"3e844594a9f07586effb8ea13b6fce6f9629a5b3b326d12ea705ee6c689b54cb"}
Sep 17 23:24:24.480708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:24.480664    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7635-a4ed49" podStartSLOduration=2.48065021 podStartE2EDuration="2.48065021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:24.478556534 +0000 UTC m=+1103.357071781" watchObservedRunningTime="2026-09-17 23:24:24.48065021 +0000 UTC m=+1103.359165455"
Sep 17 23:24:25.074396 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.074361    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-a4ed49"]
Sep 17 23:24:25.089796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.089705    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-a4ed49"]
Sep 17 23:24:25.190153 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.190114    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-ff9d10"]
Sep 17 23:24:25.190763 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.190742    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bddf4286-26d8-4387-99b0-b73518070513" containerName="test-curl-7635-a4ed49"
Sep 17 23:24:25.190859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.190765    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bddf4286-26d8-4387-99b0-b73518070513" containerName="test-curl-7635-a4ed49"
Sep 17 23:24:25.190917 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.190899    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bddf4286-26d8-4387-99b0-b73518070513" containerName="test-curl-7635-a4ed49"
Sep 17 23:24:25.194199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.194179    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:25.200495 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.200404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-ff9d10"]
Sep 17 23:24:25.352634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.352592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h49gb\" (UniqueName: \"kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb\") pod \"test-curl-7635-ff9d10\" (UID: \"a84cea09-cc78-4bbd-bc08-f3d49fec442f\") " pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:25.453595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.453513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h49gb\" (UniqueName: \"kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb\") pod \"test-curl-7635-ff9d10\" (UID: \"a84cea09-cc78-4bbd-bc08-f3d49fec442f\") " pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:25.462590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.462556    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h49gb\" (UniqueName: \"kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb\") pod \"test-curl-7635-ff9d10\" (UID: \"a84cea09-cc78-4bbd-bc08-f3d49fec442f\") " pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:25.467578 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:25.467549    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7635-a4ed49" container="test-curl-7635-a4ed49"
Sep 17 23:24:25.505009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.504982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:25.775746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:25.775723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-ff9d10"]
Sep 17 23:24:25.778423 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:24:25.778394    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda84cea09_cc78_4bbd_bc08_f3d49fec442f.slice/crio-822a048078e93bfe42c8fead9f5447bd99315034b1a44f60c6da1918fdd9cc6b WatchSource:0}: Error finding container 822a048078e93bfe42c8fead9f5447bd99315034b1a44f60c6da1918fdd9cc6b: Status 404 returned error can't find the container with id 822a048078e93bfe42c8fead9f5447bd99315034b1a44f60c6da1918fdd9cc6b
Sep 17 23:24:26.473805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:26.473770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-ff9d10" event={"ID":"a84cea09-cc78-4bbd-bc08-f3d49fec442f","Type":"ContainerStarted","Data":"231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30"}
Sep 17 23:24:26.473805 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:26.473811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-ff9d10" event={"ID":"a84cea09-cc78-4bbd-bc08-f3d49fec442f","Type":"ContainerStarted","Data":"822a048078e93bfe42c8fead9f5447bd99315034b1a44f60c6da1918fdd9cc6b"}
Sep 17 23:24:26.474325 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:26.473927    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7635-a4ed49" podUID="bddf4286-26d8-4387-99b0-b73518070513" containerName="test-curl-7635-a4ed49" containerID="cri-o://1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed" gracePeriod=2
Sep 17 23:24:26.490422 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:26.490377    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7635-ff9d10" podStartSLOduration=1.490363769 podStartE2EDuration="1.490363769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:26.488326094 +0000 UTC m=+1105.366841359" watchObservedRunningTime="2026-09-17 23:24:26.490363769 +0000 UTC m=+1105.368879062"
Sep 17 23:24:27.083013 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.082976    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-ff9d10"]
Sep 17 23:24:27.088009 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.087981    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-ff9d10"]
Sep 17 23:24:27.202686 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.202655    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-8055ab"]
Sep 17 23:24:27.203121 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.203107    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" containerName="test-curl-7635-ff9d10"
Sep 17 23:24:27.203173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.203123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" containerName="test-curl-7635-ff9d10"
Sep 17 23:24:27.203227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.203217    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" containerName="test-curl-7635-ff9d10"
Sep 17 23:24:27.206403 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.206385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:27.210445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.210423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-8055ab"]
Sep 17 23:24:27.372469 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.372436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvw6h\" (UniqueName: \"kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h\") pod \"test-curl-7635-8055ab\" (UID: \"16f81e47-c32d-423e-9318-8a0daced68ec\") " pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:27.473019 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.472934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvw6h\" (UniqueName: \"kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h\") pod \"test-curl-7635-8055ab\" (UID: \"16f81e47-c32d-423e-9318-8a0daced68ec\") " pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:27.480193 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:27.480169    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7635-ff9d10" container="test-curl-7635-ff9d10"
Sep 17 23:24:27.481856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.481829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvw6h\" (UniqueName: \"kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h\") pod \"test-curl-7635-8055ab\" (UID: \"16f81e47-c32d-423e-9318-8a0daced68ec\") " pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:27.516573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.516547    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:27.789722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:27.789698    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-8055ab"]
Sep 17 23:24:27.792075 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:24:27.792031    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16f81e47_c32d_423e_9318_8a0daced68ec.slice/crio-67d2eca408df9c42864209885c9ff2c648aa7d40d6f17e937a60464996e749c5 WatchSource:0}: Error finding container 67d2eca408df9c42864209885c9ff2c648aa7d40d6f17e937a60464996e749c5: Status 404 returned error can't find the container with id 67d2eca408df9c42864209885c9ff2c648aa7d40d6f17e937a60464996e749c5
Sep 17 23:24:28.487859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.487831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-8055ab" event={"ID":"16f81e47-c32d-423e-9318-8a0daced68ec","Type":"ContainerStarted","Data":"7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9"}
Sep 17 23:24:28.488250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.487876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-8055ab" event={"ID":"16f81e47-c32d-423e-9318-8a0daced68ec","Type":"ContainerStarted","Data":"67d2eca408df9c42864209885c9ff2c648aa7d40d6f17e937a60464996e749c5"}
Sep 17 23:24:28.488250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.487947    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7635-ff9d10" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" containerName="test-curl-7635-ff9d10" containerID="cri-o://231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30" gracePeriod=2
Sep 17 23:24:28.502573 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.502522    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7635-8055ab" podStartSLOduration=1.502508702 podStartE2EDuration="1.502508702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:28.500780135 +0000 UTC m=+1107.379295381" watchObservedRunningTime="2026-09-17 23:24:28.502508702 +0000 UTC m=+1107.381024001"
Sep 17 23:24:28.659252 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.659226    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:28.787212 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.787121    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wz4t\" (UniqueName: \"kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t\") pod \"bddf4286-26d8-4387-99b0-b73518070513\" (UID: \"bddf4286-26d8-4387-99b0-b73518070513\") "
Sep 17 23:24:28.789182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.789156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t" (OuterVolumeSpecName: "kube-api-access-9wz4t") pod "bddf4286-26d8-4387-99b0-b73518070513" (UID: "bddf4286-26d8-4387-99b0-b73518070513"). InnerVolumeSpecName "kube-api-access-9wz4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:28.888224 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:28.888199    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wz4t\" (UniqueName: \"kubernetes.io/projected/bddf4286-26d8-4387-99b0-b73518070513-kube-api-access-9wz4t\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:29.087354 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.087263    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-8055ab"]
Sep 17 23:24:29.096971 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.096944    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-8055ab"]
Sep 17 23:24:29.228809 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.228774    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7635-8b382e"]
Sep 17 23:24:29.229275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.229260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" containerName="test-curl-7635-8055ab"
Sep 17 23:24:29.229275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.229275    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" containerName="test-curl-7635-8055ab"
Sep 17 23:24:29.229378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.229348    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" containerName="test-curl-7635-8055ab"
Sep 17 23:24:29.232532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.232517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:29.239982 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.239955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-8b382e"]
Sep 17 23:24:29.391983 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.391888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7r8g\" (UniqueName: \"kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g\") pod \"test-curl-7635-8b382e\" (UID: \"08310a2a-2e23-45f5-a5ff-bf8d75bd432b\") " pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:29.493010 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.492977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7r8g\" (UniqueName: \"kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g\") pod \"test-curl-7635-8b382e\" (UID: \"08310a2a-2e23-45f5-a5ff-bf8d75bd432b\") " pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:29.495179 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.495149    2581 generic.go:356] "Generic (PLEG): container finished" podID="bddf4286-26d8-4387-99b0-b73518070513" containerID="1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed" exitCode=137
Sep 17 23:24:29.495320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.495202    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:29.495320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.495242    2581 scope.go:117] "RemoveContainer" containerID="1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed"
Sep 17 23:24:29.495582 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:29.495562    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7635-8055ab" container="test-curl-7635-8055ab"
Sep 17 23:24:29.501566 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.501544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7r8g\" (UniqueName: \"kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g\") pod \"test-curl-7635-8b382e\" (UID: \"08310a2a-2e23-45f5-a5ff-bf8d75bd432b\") " pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:29.504465 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.504450    2581 scope.go:117] "RemoveContainer" containerID="1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed"
Sep 17 23:24:29.504754 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:29.504729    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed\": container with ID starting with 1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed not found: ID does not exist" containerID="1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed"
Sep 17 23:24:29.504810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.504755    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed"} err="failed to get container status \"1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed\": rpc error: code = NotFound desc = could not find container \"1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed\": container with ID starting with 1cc2265f1cd40cb224d3fd1b7251edbcc62852347c0372fdce6521c676da29ed not found: ID does not exist"
Sep 17 23:24:29.514218 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:29.514195    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-a4ed49\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="bddf4286-26d8-4387-99b0-b73518070513" pod="opendatahub/test-curl-7635-a4ed49"
Sep 17 23:24:29.543978 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.543959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:29.661692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.661662    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bddf4286-26d8-4387-99b0-b73518070513" path="/var/lib/kubelet/pods/bddf4286-26d8-4387-99b0-b73518070513/volumes"
Sep 17 23:24:29.812182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:29.812160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7635-8b382e"]
Sep 17 23:24:29.814212 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:24:29.814181    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08310a2a_2e23_45f5_a5ff_bf8d75bd432b.slice/crio-8926439dcd02b8028d922e3feecb9a31ec870fc9aebceea96691f2448201af46 WatchSource:0}: Error finding container 8926439dcd02b8028d922e3feecb9a31ec870fc9aebceea96691f2448201af46: Status 404 returned error can't find the container with id 8926439dcd02b8028d922e3feecb9a31ec870fc9aebceea96691f2448201af46
Sep 17 23:24:30.393032 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.392996    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:24:30.393253 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.393232    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" podUID="0dbb6c21-e571-445d-bffc-126e849faa3c" containerName="maas-api" containerID="cri-o://71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe" gracePeriod=30
Sep 17 23:24:30.504025 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.503992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-8b382e" event={"ID":"08310a2a-2e23-45f5-a5ff-bf8d75bd432b","Type":"ContainerStarted","Data":"7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93"}
Sep 17 23:24:30.504389 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.504039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7635-8b382e" event={"ID":"08310a2a-2e23-45f5-a5ff-bf8d75bd432b","Type":"ContainerStarted","Data":"8926439dcd02b8028d922e3feecb9a31ec870fc9aebceea96691f2448201af46"}
Sep 17 23:24:30.505177 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.505152    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7635-8055ab" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" containerName="test-curl-7635-8055ab" containerID="cri-o://7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9" gracePeriod=2
Sep 17 23:24:30.520826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.520782    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7635-8b382e" podStartSLOduration=1.520766145 podStartE2EDuration="1.520766145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:30.51856463 +0000 UTC m=+1109.397079877" watchObservedRunningTime="2026-09-17 23:24:30.520766145 +0000 UTC m=+1109.399281390"
Sep 17 23:24:30.645300 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.645241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:30.684319 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.684295    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:24:30.807000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.806971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca\") pod \"0dbb6c21-e571-445d-bffc-126e849faa3c\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") "
Sep 17 23:24:30.807207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.807017    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc2w6\" (UniqueName: \"kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6\") pod \"0dbb6c21-e571-445d-bffc-126e849faa3c\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") "
Sep 17 23:24:30.807207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.807085    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") pod \"0dbb6c21-e571-445d-bffc-126e849faa3c\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") "
Sep 17 23:24:30.807207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.807139    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs\") pod \"0dbb6c21-e571-445d-bffc-126e849faa3c\" (UID: \"0dbb6c21-e571-445d-bffc-126e849faa3c\") "
Sep 17 23:24:30.807207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.807179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h49gb\" (UniqueName: \"kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb\") pod \"a84cea09-cc78-4bbd-bc08-f3d49fec442f\" (UID: \"a84cea09-cc78-4bbd-bc08-f3d49fec442f\") "
Sep 17 23:24:30.807466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.807438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0dbb6c21-e571-445d-bffc-126e849faa3c" (UID: "0dbb6c21-e571-445d-bffc-126e849faa3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:24:30.809265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.809238    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0dbb6c21-e571-445d-bffc-126e849faa3c" (UID: "0dbb6c21-e571-445d-bffc-126e849faa3c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:24:30.809387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.809274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6" (OuterVolumeSpecName: "kube-api-access-qc2w6") pod "0dbb6c21-e571-445d-bffc-126e849faa3c" (UID: "0dbb6c21-e571-445d-bffc-126e849faa3c"). InnerVolumeSpecName "kube-api-access-qc2w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:30.809387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.809330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb" (OuterVolumeSpecName: "kube-api-access-h49gb") pod "a84cea09-cc78-4bbd-bc08-f3d49fec442f" (UID: "a84cea09-cc78-4bbd-bc08-f3d49fec442f"). InnerVolumeSpecName "kube-api-access-h49gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:30.809387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.809375    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0dbb6c21-e571-445d-bffc-126e849faa3c" (UID: "0dbb6c21-e571-445d-bffc-126e849faa3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:24:30.908204 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.908184    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:30.908312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.908208    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h49gb\" (UniqueName: \"kubernetes.io/projected/a84cea09-cc78-4bbd-bc08-f3d49fec442f-kube-api-access-h49gb\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:30.908312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.908217    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0dbb6c21-e571-445d-bffc-126e849faa3c-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:30.908312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.908228    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc2w6\" (UniqueName: \"kubernetes.io/projected/0dbb6c21-e571-445d-bffc-126e849faa3c-kube-api-access-qc2w6\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:30.908312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:30.908237    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0dbb6c21-e571-445d-bffc-126e849faa3c-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:31.107265 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.107233    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7635-8b382e"]
Sep 17 23:24:31.112207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.112121    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7635-8b382e"]
Sep 17 23:24:31.511879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.511844    2581 generic.go:356] "Generic (PLEG): container finished" podID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" containerID="231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30" exitCode=137
Sep 17 23:24:31.512323 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.511884    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:31.512323 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.511947    2581 scope.go:117] "RemoveContainer" containerID="231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30"
Sep 17 23:24:31.513448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.513428    2581 generic.go:356] "Generic (PLEG): container finished" podID="0dbb6c21-e571-445d-bffc-126e849faa3c" containerID="71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe" exitCode=0
Sep 17 23:24:31.513578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.513467    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"
Sep 17 23:24:31.513578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.513509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" event={"ID":"0dbb6c21-e571-445d-bffc-126e849faa3c","Type":"ContainerDied","Data":"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"}
Sep 17 23:24:31.513578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.513568    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7" event={"ID":"0dbb6c21-e571-445d-bffc-126e849faa3c","Type":"ContainerDied","Data":"1dd7815a6b847a77ed380084f209ef24cf5f29b3a0cf3f087b03cbdc98ad65e7"}
Sep 17 23:24:31.513858 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.513837    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7635-8b382e" container="test-curl-7635-8b382e"
Sep 17 23:24:31.522961 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.522949    2581 scope.go:117] "RemoveContainer" containerID="231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30"
Sep 17 23:24:31.523260 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.523236    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30\": container with ID starting with 231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30 not found: ID does not exist" containerID="231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30"
Sep 17 23:24:31.523352 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.523270    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30"} err="failed to get container status \"231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30\": rpc error: code = NotFound desc = could not find container \"231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30\": container with ID starting with 231fe626c99b2ea65d3d3e7ae604a4bfe84dcbcae208974f003bc9fdb9a79f30 not found: ID does not exist"
Sep 17 23:24:31.523352 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.523295    2581 scope.go:117] "RemoveContainer" containerID="71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"
Sep 17 23:24:31.523824 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.523801    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-ff9d10\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:31.531885 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.531868    2581 scope.go:117] "RemoveContainer" containerID="71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"
Sep 17 23:24:31.532174 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.532155    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe\": container with ID starting with 71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe not found: ID does not exist" containerID="71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"
Sep 17 23:24:31.532247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.532180    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe"} err="failed to get container status \"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe\": rpc error: code = NotFound desc = could not find container \"71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe\": container with ID starting with 71dc41f20b60b6ca04a9b78c48b3d75c5b049dd0e9b1a332821492f934c746fe not found: ID does not exist"
Sep 17 23:24:31.537662 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.537640    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:24:31.541290 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.541267    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-ff9d10\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:31.541743 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.541723    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-7aa654-7765495cc9-bfhk7"]
Sep 17 23:24:31.659182 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:31.659146    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-ff9d10\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" pod="opendatahub/test-curl-7635-ff9d10"
Sep 17 23:24:31.661743 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.661720    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dbb6c21-e571-445d-bffc-126e849faa3c" path="/var/lib/kubelet/pods/0dbb6c21-e571-445d-bffc-126e849faa3c/volumes"
Sep 17 23:24:31.662133 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:31.662118    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a84cea09-cc78-4bbd-bc08-f3d49fec442f" path="/var/lib/kubelet/pods/a84cea09-cc78-4bbd-bc08-f3d49fec442f/volumes"
Sep 17 23:24:32.522156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:32.522125    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7635-8b382e" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" containerName="test-curl-7635-8b382e" containerID="cri-o://7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93" gracePeriod=2
Sep 17 23:24:32.695779 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:32.695753    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:32.826859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:32.826775    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvw6h\" (UniqueName: \"kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h\") pod \"16f81e47-c32d-423e-9318-8a0daced68ec\" (UID: \"16f81e47-c32d-423e-9318-8a0daced68ec\") "
Sep 17 23:24:32.828926 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:32.828895    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h" (OuterVolumeSpecName: "kube-api-access-bvw6h") pod "16f81e47-c32d-423e-9318-8a0daced68ec" (UID: "16f81e47-c32d-423e-9318-8a0daced68ec"). InnerVolumeSpecName "kube-api-access-bvw6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:32.928211 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:32.928178    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvw6h\" (UniqueName: \"kubernetes.io/projected/16f81e47-c32d-423e-9318-8a0daced68ec-kube-api-access-bvw6h\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:33.529036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.528997    2581 generic.go:356] "Generic (PLEG): container finished" podID="16f81e47-c32d-423e-9318-8a0daced68ec" containerID="7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9" exitCode=137
Sep 17 23:24:33.529036 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.529057    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:33.529469 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.529098    2581 scope.go:117] "RemoveContainer" containerID="7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9"
Sep 17 23:24:33.538133 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.538116    2581 scope.go:117] "RemoveContainer" containerID="7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9"
Sep 17 23:24:33.538389 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:33.538370    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9\": container with ID starting with 7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9 not found: ID does not exist" containerID="7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9"
Sep 17 23:24:33.538389 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.538397    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9"} err="failed to get container status \"7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9\": rpc error: code = NotFound desc = could not find container \"7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9\": container with ID starting with 7b65f8c5ab20ff9e15b28492cf0e788a56e0b19949d121a0826ef88637da07d9 not found: ID does not exist"
Sep 17 23:24:33.539306 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:33.539287    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-8055ab\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" pod="opendatahub/test-curl-7635-8055ab"
Sep 17 23:24:33.661344 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:33.661314    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16f81e47-c32d-423e-9318-8a0daced68ec" path="/var/lib/kubelet/pods/16f81e47-c32d-423e-9318-8a0daced68ec/volumes"
Sep 17 23:24:34.709150 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:34.709129    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:34.848740 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:34.848636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7r8g\" (UniqueName: \"kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g\") pod \"08310a2a-2e23-45f5-a5ff-bf8d75bd432b\" (UID: \"08310a2a-2e23-45f5-a5ff-bf8d75bd432b\") "
Sep 17 23:24:34.851379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:34.851344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g" (OuterVolumeSpecName: "kube-api-access-z7r8g") pod "08310a2a-2e23-45f5-a5ff-bf8d75bd432b" (UID: "08310a2a-2e23-45f5-a5ff-bf8d75bd432b"). InnerVolumeSpecName "kube-api-access-z7r8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:34.950215 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:34.950182    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7r8g\" (UniqueName: \"kubernetes.io/projected/08310a2a-2e23-45f5-a5ff-bf8d75bd432b-kube-api-access-z7r8g\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:35.541875 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.541834    2581 generic.go:356] "Generic (PLEG): container finished" podID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" containerID="7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93" exitCode=137
Sep 17 23:24:35.542104 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.541884    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:35.542104 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.541901    2581 scope.go:117] "RemoveContainer" containerID="7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93"
Sep 17 23:24:35.551179 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.551159    2581 scope.go:117] "RemoveContainer" containerID="7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93"
Sep 17 23:24:35.551476 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:35.551456    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93\": container with ID starting with 7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93 not found: ID does not exist" containerID="7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93"
Sep 17 23:24:35.551551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.551485    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93"} err="failed to get container status \"7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93\": rpc error: code = NotFound desc = could not find container \"7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93\": container with ID starting with 7eb33130793ef1271c52e2fc91558e4c4ec49315a5d3e5f8104afee88529df93 not found: ID does not exist"
Sep 17 23:24:35.552431 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:24:35.552406    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7635-8b382e\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" pod="opendatahub/test-curl-7635-8b382e"
Sep 17 23:24:35.661900 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:35.661861    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" path="/var/lib/kubelet/pods/08310a2a-2e23-45f5-a5ff-bf8d75bd432b/volumes"
Sep 17 23:24:40.108057 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.108008    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:24:40.109173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109147    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dbb6c21-e571-445d-bffc-126e849faa3c" containerName="maas-api"
Sep 17 23:24:40.109173 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109172    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dbb6c21-e571-445d-bffc-126e849faa3c" containerName="maas-api"
Sep 17 23:24:40.109356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109190    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" containerName="test-curl-7635-8b382e"
Sep 17 23:24:40.109356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109199    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" containerName="test-curl-7635-8b382e"
Sep 17 23:24:40.109356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109316    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dbb6c21-e571-445d-bffc-126e849faa3c" containerName="maas-api"
Sep 17 23:24:40.109356 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.109328    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="08310a2a-2e23-45f5-a5ff-bf8d75bd432b" containerName="test-curl-7635-8b382e"
Sep 17 23:24:40.114004 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.113984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.116442 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.116419    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6824f488-serving-cert\""
Sep 17 23:24:40.124875 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.124849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:24:40.200934 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.200900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.200934 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.200942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.201164 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.200972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.201164 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.201110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfzgk\" (UniqueName: \"kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.302610 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.302570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.302759 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.302617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.302759 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.302669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfzgk\" (UniqueName: \"kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.302759 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.302733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.303433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.303408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.305184 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.305153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.305277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.305215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.310533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.310503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfzgk\" (UniqueName: \"kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk\") pod \"maas-api-e2e-mt-6824f488-67b655f5c-pqlt2\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.431106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.431073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:40.709955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:40.709929    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:24:40.711732 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:24:40.711701    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cb8c8b_8593_47c7_b0f5_c2e46c7a5999.slice/crio-15814a29d4a32b621f3bd38b7ff8ab9971eb00c419397a740b1ae718d620197f WatchSource:0}: Error finding container 15814a29d4a32b621f3bd38b7ff8ab9971eb00c419397a740b1ae718d620197f: Status 404 returned error can't find the container with id 15814a29d4a32b621f3bd38b7ff8ab9971eb00c419397a740b1ae718d620197f
Sep 17 23:24:41.576180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:41.576083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" event={"ID":"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999","Type":"ContainerStarted","Data":"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"}
Sep 17 23:24:41.576180 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:41.576139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" event={"ID":"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999","Type":"ContainerStarted","Data":"15814a29d4a32b621f3bd38b7ff8ab9971eb00c419397a740b1ae718d620197f"}
Sep 17 23:24:41.576594 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:41.576183    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:41.596275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:41.596225    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" podStartSLOduration=1.099176103 podStartE2EDuration="1.596209662s" totalImagesPullingTime="497.033559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:24:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:24:41.593812938 +0000 UTC m=+1120.472328184" watchObservedRunningTime="2026-09-17 23:24:41.596209662 +0000 UTC m=+1120.474724907"
Sep 17 23:24:47.588542 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:47.588512    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:24:48.377857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.377808    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:24:48.378124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.378096    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" podUID="102d60a1-2341-43a4-bb17-79826bbbba71" containerName="maas-api" containerID="cri-o://714bbe2ff83414d6a2208a9387af049350db770bd12c1f640c790b75ea0ca0e3" gracePeriod=30
Sep 17 23:24:48.618687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.618656    2581 generic.go:356] "Generic (PLEG): container finished" podID="102d60a1-2341-43a4-bb17-79826bbbba71" containerID="714bbe2ff83414d6a2208a9387af049350db770bd12c1f640c790b75ea0ca0e3" exitCode=0
Sep 17 23:24:48.619083 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.618738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" event={"ID":"102d60a1-2341-43a4-bb17-79826bbbba71","Type":"ContainerDied","Data":"714bbe2ff83414d6a2208a9387af049350db770bd12c1f640c790b75ea0ca0e3"}
Sep 17 23:24:48.648659 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.648633    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:24:48.784833 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.784797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca\") pod \"102d60a1-2341-43a4-bb17-79826bbbba71\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") "
Sep 17 23:24:48.784983 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.784853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs\") pod \"102d60a1-2341-43a4-bb17-79826bbbba71\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") "
Sep 17 23:24:48.784983 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.784965    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls\") pod \"102d60a1-2341-43a4-bb17-79826bbbba71\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") "
Sep 17 23:24:48.785178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.785158    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zmpb\" (UniqueName: \"kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb\") pod \"102d60a1-2341-43a4-bb17-79826bbbba71\" (UID: \"102d60a1-2341-43a4-bb17-79826bbbba71\") "
Sep 17 23:24:48.785263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.785243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "102d60a1-2341-43a4-bb17-79826bbbba71" (UID: "102d60a1-2341-43a4-bb17-79826bbbba71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:24:48.785487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.785465    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d60a1-2341-43a4-bb17-79826bbbba71-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:48.787164 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.787141    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "102d60a1-2341-43a4-bb17-79826bbbba71" (UID: "102d60a1-2341-43a4-bb17-79826bbbba71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:24:48.787283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.787267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "102d60a1-2341-43a4-bb17-79826bbbba71" (UID: "102d60a1-2341-43a4-bb17-79826bbbba71"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:24:48.787466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.787444    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb" (OuterVolumeSpecName: "kube-api-access-7zmpb") pod "102d60a1-2341-43a4-bb17-79826bbbba71" (UID: "102d60a1-2341-43a4-bb17-79826bbbba71"). InnerVolumeSpecName "kube-api-access-7zmpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:24:48.893588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.887474    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zmpb\" (UniqueName: \"kubernetes.io/projected/102d60a1-2341-43a4-bb17-79826bbbba71-kube-api-access-7zmpb\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:48.893588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.887513    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:48.893588 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:48.887528    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/102d60a1-2341-43a4-bb17-79826bbbba71-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:24:49.626041 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.626010    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"
Sep 17 23:24:49.626041 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.626021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67" event={"ID":"102d60a1-2341-43a4-bb17-79826bbbba71","Type":"ContainerDied","Data":"bd67bc5eb6cc9371ccb17580b3313eca2269522dc54ba0a2b3c48cfb56fe01bb"}
Sep 17 23:24:49.626498 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.626178    2581 scope.go:117] "RemoveContainer" containerID="714bbe2ff83414d6a2208a9387af049350db770bd12c1f640c790b75ea0ca0e3"
Sep 17 23:24:49.647025 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.646991    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:24:49.651393 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.651369    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8fc0d3-598ff8bcd8-5dh67"]
Sep 17 23:24:49.660831 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:49.660808    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="102d60a1-2341-43a4-bb17-79826bbbba71" path="/var/lib/kubelet/pods/102d60a1-2341-43a4-bb17-79826bbbba71/volumes"
Sep 17 23:24:56.652651 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:24:56.652613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:25:04.615714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.615673    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:25:04.617302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.617273    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102d60a1-2341-43a4-bb17-79826bbbba71" containerName="maas-api"
Sep 17 23:25:04.617302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.617303    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="102d60a1-2341-43a4-bb17-79826bbbba71" containerName="maas-api"
Sep 17 23:25:04.617505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.617493    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="102d60a1-2341-43a4-bb17-79826bbbba71" containerName="maas-api"
Sep 17 23:25:04.622667 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.622645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.627261 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.627238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-e5aae7-serving-cert\""
Sep 17 23:25:04.634457 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.634165    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:25:04.746130 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.746091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.746334 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.746163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.746334 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.746219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.746440 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.746327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgcjp\" (UniqueName: \"kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.846837 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.846805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.847000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.846845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.847000 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:25:04.846952    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-serving-cert: secret "maas-api-e2e-shared-a-w3-e5aae7-serving-cert" not found
Sep 17 23:25:04.847000 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.846967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgcjp\" (UniqueName: \"kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.847150 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:25:04.847018    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls podName:f3c7fd02-d166-468c-b6a6-8050a580ad77 nodeName:}" failed. No retries permitted until 2026-09-17 23:25:05.347001525 +0000 UTC m=+1144.225516748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls") pod "maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" (UID: "f3c7fd02-d166-468c-b6a6-8050a580ad77") : secret "maas-api-e2e-shared-a-w3-e5aae7-serving-cert" not found
Sep 17 23:25:04.847198 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.847151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.847731 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.847706    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.849419 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.849397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:04.856397 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:04.856377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgcjp\" (UniqueName: \"kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:05.352170 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:05.352137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:05.354682 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:05.354648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:05.535756 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:05.535725    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:05.809111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:05.809080    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:25:05.810993 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:25:05.810966    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c7fd02_d166_468c_b6a6_8050a580ad77.slice/crio-260698653eab21d5eceaabb862f7fd6be3d1b98556a92fe831abc6eb4c4969f6 WatchSource:0}: Error finding container 260698653eab21d5eceaabb862f7fd6be3d1b98556a92fe831abc6eb4c4969f6: Status 404 returned error can't find the container with id 260698653eab21d5eceaabb862f7fd6be3d1b98556a92fe831abc6eb4c4969f6
Sep 17 23:25:06.721420 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:06.721385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" event={"ID":"f3c7fd02-d166-468c-b6a6-8050a580ad77","Type":"ContainerStarted","Data":"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"}
Sep 17 23:25:06.721605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:06.721442    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" event={"ID":"f3c7fd02-d166-468c-b6a6-8050a580ad77","Type":"ContainerStarted","Data":"260698653eab21d5eceaabb862f7fd6be3d1b98556a92fe831abc6eb4c4969f6"}
Sep 17 23:25:06.721605 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:06.721471    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:06.740314 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:06.740260    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" podStartSLOduration=2.28357368 podStartE2EDuration="2.740245369s" totalImagesPullingTime="456.671689ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:25:06.738431419 +0000 UTC m=+1145.616946664" watchObservedRunningTime="2026-09-17 23:25:06.740245369 +0000 UTC m=+1145.618760616"
Sep 17 23:25:12.732884 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:12.732853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:25:29.857475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:29.857383    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:25:33.815937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:33.815904    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:25:38.833267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.833233    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:25:38.837705 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.837685    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:38.840010 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.839986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-6275e9-serving-cert\""
Sep 17 23:25:38.849340 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.849284    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:25:38.956879 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.956845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4g9\" (UniqueName: \"kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:38.957103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.956918    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:38.957103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.957031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:38.957103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:38.957093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.058576 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.058534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.058746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.058596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.058746 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.058653    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4g9\" (UniqueName: \"kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.058746 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:25:39.058684    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-serving-cert: secret "maas-api-e2e-shared-b-w3-6275e9-serving-cert" not found
Sep 17 23:25:39.058882 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:25:39.058766    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls podName:47079b23-8722-489a-8e41-f8932df2a15b nodeName:}" failed. No retries permitted until 2026-09-17 23:25:39.558747317 +0000 UTC m=+1178.437262544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls") pod "maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" (UID: "47079b23-8722-489a-8e41-f8932df2a15b") : secret "maas-api-e2e-shared-b-w3-6275e9-serving-cert" not found
Sep 17 23:25:39.058882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.058851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.059269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.059245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.061345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.061323    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.070081 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.070037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4g9\" (UniqueName: \"kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.564946 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.564909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.567377 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.567347    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:39.749318 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:39.749287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:40.026690 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:40.026663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:25:40.028820 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:25:40.028793    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47079b23_8722_489a_8e41_f8932df2a15b.slice/crio-9bb2af797529451c38b2d395236b5dd701eaad17f900fe110866f0f22f0e775f WatchSource:0}: Error finding container 9bb2af797529451c38b2d395236b5dd701eaad17f900fe110866f0f22f0e775f: Status 404 returned error can't find the container with id 9bb2af797529451c38b2d395236b5dd701eaad17f900fe110866f0f22f0e775f
Sep 17 23:25:40.910308 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:40.910269    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" event={"ID":"47079b23-8722-489a-8e41-f8932df2a15b","Type":"ContainerStarted","Data":"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"}
Sep 17 23:25:40.910470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:40.910352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" event={"ID":"47079b23-8722-489a-8e41-f8932df2a15b","Type":"ContainerStarted","Data":"9bb2af797529451c38b2d395236b5dd701eaad17f900fe110866f0f22f0e775f"}
Sep 17 23:25:40.910470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:40.910389    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:40.929198 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:40.929145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" podStartSLOduration=2.529822264 podStartE2EDuration="2.929130168s" totalImagesPullingTime="399.307904ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:25:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:25:40.926532528 +0000 UTC m=+1179.805047770" watchObservedRunningTime="2026-09-17 23:25:40.929130168 +0000 UTC m=+1179.807645413"
Sep 17 23:25:46.920914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:46.920883    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:25:48.835781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:48.835739    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" podUID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" containerName="main" containerID="cri-o://db7a0cc75e4c02ccefcf3350dcdeb858375111c225e16fddb91d57cad2261510" gracePeriod=45
Sep 17 23:25:48.955027 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:48.954999    2581 generic.go:356] "Generic (PLEG): container finished" podID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" containerID="db7a0cc75e4c02ccefcf3350dcdeb858375111c225e16fddb91d57cad2261510" exitCode=0
Sep 17 23:25:48.955170 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:48.955101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" event={"ID":"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d","Type":"ContainerDied","Data":"db7a0cc75e4c02ccefcf3350dcdeb858375111c225e16fddb91d57cad2261510"}
Sep 17 23:25:49.093864 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.093799    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:25:49.165640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165639    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165858 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165734    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165858 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165750    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165858 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnxbq\" (UniqueName: \"kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165997 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165900    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir\") pod \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\" (UID: \"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d\") "
Sep 17 23:25:49.165997 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.165942    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache" (OuterVolumeSpecName: "model-cache") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:25:49.166147 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.166034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home" (OuterVolumeSpecName: "home") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:25:49.166223 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.166198    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:25:49.166417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.166371    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-model-cache\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.166417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.166391    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-home\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.166417 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.166404    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tmp-dir\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.168123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.168094    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq" (OuterVolumeSpecName: "kube-api-access-cnxbq") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "kube-api-access-cnxbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:25:49.168123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.168119    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm" (OuterVolumeSpecName: "dshm") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:25:49.168279 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.168185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" (UID: "bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:25:49.266932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.266886    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-tls-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.266932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.266926    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnxbq\" (UniqueName: \"kubernetes.io/projected/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-kube-api-access-cnxbq\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.266932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.266934    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d-dshm\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:25:49.962320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.962235    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"
Sep 17 23:25:49.962320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.962268    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6" event={"ID":"bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d","Type":"ContainerDied","Data":"d991bfc6ca380f63537205bdf616d966a14a7fe1ee41c5f1966faad22f45325a"}
Sep 17 23:25:49.962320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.962320    2581 scope.go:117] "RemoveContainer" containerID="db7a0cc75e4c02ccefcf3350dcdeb858375111c225e16fddb91d57cad2261510"
Sep 17 23:25:49.978475 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.978450    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:25:49.983714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:49.983686    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-7ab633/e2e-conflict-b-21551ab9-kserve-7cc849767f-c97l6"]
Sep 17 23:25:51.662055 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:51.662012    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" path="/var/lib/kubelet/pods/bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d/volumes"
Sep 17 23:25:57.340325 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:25:57.340288    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:26:01.648384 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:26:01.648358    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:26:01.649991 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:26:01.649972    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:26:39.357707 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:26:39.357671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:27:13.551785 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:13.551707    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:27:17.100195 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.100159    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:27:17.422905 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.422858    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerName="maas-api" containerID="cri-o://50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a" gracePeriod=30
Sep 17 23:27:17.584114 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.584070    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.73:8443/health\": dial tcp 10.132.0.73:8443: connect: connection refused"
Sep 17 23:27:17.673321 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.673261    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:27:17.800330 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800298    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs\") pod \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") "
Sep 17 23:27:17.800526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca\") pod \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") "
Sep 17 23:27:17.800526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800404    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls\") pod \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") "
Sep 17 23:27:17.800526 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800517    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfzgk\" (UniqueName: \"kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk\") pod \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\" (UID: \"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999\") "
Sep 17 23:27:17.800728 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" (UID: "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:27:17.800832 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.800816    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:27:17.802533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.802499    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" (UID: "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:27:17.802533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.802518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" (UID: "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:27:17.802662 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.802535    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk" (OuterVolumeSpecName: "kube-api-access-vfzgk") pod "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" (UID: "51cb8c8b-8593-47c7-b0f5-c2e46c7a5999"). InnerVolumeSpecName "kube-api-access-vfzgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:27:17.901835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.901804    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:27:17.901835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.901830    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfzgk\" (UniqueName: \"kubernetes.io/projected/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-kube-api-access-vfzgk\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:27:17.901835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:17.901842    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:27:18.435438 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.435394    2581 generic.go:356] "Generic (PLEG): container finished" podID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerID="50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a" exitCode=0
Sep 17 23:27:18.435860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.435456    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"
Sep 17 23:27:18.435860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.435482    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" event={"ID":"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999","Type":"ContainerDied","Data":"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"}
Sep 17 23:27:18.435860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.435554    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2" event={"ID":"51cb8c8b-8593-47c7-b0f5-c2e46c7a5999","Type":"ContainerDied","Data":"15814a29d4a32b621f3bd38b7ff8ab9971eb00c419397a740b1ae718d620197f"}
Sep 17 23:27:18.435860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.435576    2581 scope.go:117] "RemoveContainer" containerID="50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"
Sep 17 23:27:18.448693 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.448673    2581 scope.go:117] "RemoveContainer" containerID="50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"
Sep 17 23:27:18.449013 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:27:18.448988    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a\": container with ID starting with 50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a not found: ID does not exist" containerID="50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"
Sep 17 23:27:18.449084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.449023    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a"} err="failed to get container status \"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a\": rpc error: code = NotFound desc = could not find container \"50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a\": container with ID starting with 50f1b1c314c3676b48e6c85fe7eb2bb48a0ded5dcfebf270fddec958e996505a not found: ID does not exist"
Sep 17 23:27:18.461796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.461768    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:27:18.463827 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:18.463803    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6824f488-67b655f5c-pqlt2"]
Sep 17 23:27:19.661732 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:19.661697    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" path="/var/lib/kubelet/pods/51cb8c8b-8593-47c7-b0f5-c2e46c7a5999/volumes"
Sep 17 23:27:44.145407 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:27:44.145374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:28:14.576069 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:28:14.576011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:28:54.341643 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:28:54.341612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:29:09.078694 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.078661    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:29:09.079341 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079320    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" containerName="main"
Sep 17 23:29:09.079446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079343    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" containerName="main"
Sep 17 23:29:09.079446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079364    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerName="maas-api"
Sep 17 23:29:09.079446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079372    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerName="maas-api"
Sep 17 23:29:09.079607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079502    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd4e2a2-52e2-4d0a-870c-d0f5fa719b0d" containerName="main"
Sep 17 23:29:09.079607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.079515    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="51cb8c8b-8593-47c7-b0f5-c2e46c7a5999" containerName="maas-api"
Sep 17 23:29:09.082895 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.082872    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.085513 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.085485    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-eb0661-openshift-default-dockercfg-j6mz2\""
Sep 17 23:29:09.093406 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.093384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:29:09.160256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160256 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.160515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.160445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlznb\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.261821 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlznb\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.262223 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.261988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.262223 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.262026    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.262223 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.262121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.262390 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.262234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.262672 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.262651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.264218 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.264194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.264467 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.264448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.269536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.269496    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlznb\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.269654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.269611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token\") pod \"e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") " pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.394416 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.394329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:09.673532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.673503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:29:09.675295 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:29:09.675265    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92162ff9_ad90_4e54_832a_fe5f243e83db.slice/crio-14638a387503ad3e282c64cf5893acad8575422df72dbde1f491034af01c0800 WatchSource:0}: Error finding container 14638a387503ad3e282c64cf5893acad8575422df72dbde1f491034af01c0800: Status 404 returned error can't find the container with id 14638a387503ad3e282c64cf5893acad8575422df72dbde1f491034af01c0800
Sep 17 23:29:09.677855 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.677823    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:09.677930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.677888    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:09.677930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:09.677915    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:10.025867 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:10.025788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerStarted","Data":"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"}
Sep 17 23:29:10.025867 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:10.025837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerStarted","Data":"14638a387503ad3e282c64cf5893acad8575422df72dbde1f491034af01c0800"}
Sep 17 23:29:10.049340 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:10.049286    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podStartSLOduration=1.049269146 podStartE2EDuration="1.049269146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:29:10.047587768 +0000 UTC m=+1388.926103013" watchObservedRunningTime="2026-09-17 23:29:10.049269146 +0000 UTC m=+1388.927784388"
Sep 17 23:29:10.394978 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:10.394893    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:10.400091 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:10.400036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:11.031383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:11.031351    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:11.032439 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:11.032418    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:16.120859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.120739    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:29:16.128106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.125117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.128106 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.127332    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-eb0661-serving-cert\""
Sep 17 23:29:16.139123 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.139096    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:29:16.235504 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.235473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.235708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.235581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.235708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.235639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqsl\" (UniqueName: \"kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.235708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.235671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.336455 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.336421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.336647 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.336468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqsl\" (UniqueName: \"kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.336647 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.336485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.336647 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.336581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.337197 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.337170    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.338932 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.338909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.339018 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.338979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.343948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.343928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqsl\" (UniqueName: \"kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl\") pod \"maas-api-e2e-api-a-eb0661-69bd864498-wwfh9\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.437374 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.437337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:16.714622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.714597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:29:16.716570 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:29:16.716542    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode891ba10_82ec_42c7_8777_4593ff352678.slice/crio-f7147b975e2e6744b5bc509109a6cf472945057011d19707747c28a8785c83ba WatchSource:0}: Error finding container f7147b975e2e6744b5bc509109a6cf472945057011d19707747c28a8785c83ba: Status 404 returned error can't find the container with id f7147b975e2e6744b5bc509109a6cf472945057011d19707747c28a8785c83ba
Sep 17 23:29:16.718365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:16.718345    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:29:17.065260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:17.065162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" event={"ID":"e891ba10-82ec-42c7-8777-4593ff352678","Type":"ContainerStarted","Data":"f7147b975e2e6744b5bc509109a6cf472945057011d19707747c28a8785c83ba"}
Sep 17 23:29:18.072685 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:18.072652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" event={"ID":"e891ba10-82ec-42c7-8777-4593ff352678","Type":"ContainerStarted","Data":"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"}
Sep 17 23:29:18.073182 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:18.072787    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:18.091790 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:18.091736    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" podStartSLOduration=1.6009556790000001 podStartE2EDuration="2.091719225s" totalImagesPullingTime="490.763546ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:29:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:29:18.090999697 +0000 UTC m=+1396.969514935" watchObservedRunningTime="2026-09-17 23:29:18.091719225 +0000 UTC m=+1396.970234471"
Sep 17 23:29:24.085492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:24.085462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:29:38.145560 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:38.145522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:29:42.695034 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.694981    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:29:42.716289 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.716092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.716289 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.716037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:29:42.720750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.720714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-00d34b-openshift-default-dockercfg-kb9k6\""
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812609    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m6bf\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.815072 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.812976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.913886 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.913845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.913896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m6bf\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.913923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.913946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914101 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914559 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914709 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914777    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.914936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.915099 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.914937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.916627 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.916601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.916998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.916975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.922084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.922040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:42.922612 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:42.922596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m6bf\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf\") pod \"e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") " pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:43.033547 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:43.033459    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:43.340571 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:43.340547    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:29:43.342716 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:29:43.342688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe33632c_b09a_4e81_b967_9defe363eff0.slice/crio-71a81482178c8c5e0a756c2e91ec33f75bbd2c97907b4ca0fb9a639a2a7ab530 WatchSource:0}: Error finding container 71a81482178c8c5e0a756c2e91ec33f75bbd2c97907b4ca0fb9a639a2a7ab530: Status 404 returned error can't find the container with id 71a81482178c8c5e0a756c2e91ec33f75bbd2c97907b4ca0fb9a639a2a7ab530
Sep 17 23:29:43.345395 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:43.345361    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:43.345470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:43.345425    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:43.345470 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:43.345453    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:44.223161 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:44.223125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerStarted","Data":"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"}
Sep 17 23:29:44.223656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:44.223177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerStarted","Data":"71a81482178c8c5e0a756c2e91ec33f75bbd2c97907b4ca0fb9a639a2a7ab530"}
Sep 17 23:29:44.244149 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:44.244096    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podStartSLOduration=2.244080291 podStartE2EDuration="2.244080291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:29:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:29:44.24293704 +0000 UTC m=+1423.121452298" watchObservedRunningTime="2026-09-17 23:29:44.244080291 +0000 UTC m=+1423.122595537"
Sep 17 23:29:45.033587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:45.033551    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:45.039326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:45.039302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:45.228871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:45.228841    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:45.229893 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:45.229875    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:29:50.259333 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.259299    2581 generic.go:356] "Generic (PLEG): container finished" podID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerID="5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8" exitCode=0
Sep 17 23:29:50.259781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.259370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerDied","Data":"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"}
Sep 17 23:29:50.259825 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.259806    2581 scope.go:117] "RemoveContainer" containerID="5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"
Sep 17 23:29:50.260936 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.260911    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:50.260996 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.260975    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:50.261032 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:50.261005    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:29:51.267770 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:51.267738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerStarted","Data":"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"}
Sep 17 23:29:51.393863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:51.393802    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:29:51.395137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:51.395109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:51.396564 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:51.396538    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:51.397014 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:51.396985    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:52.395371 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.395321    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:52.395923 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.395401    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:52.728568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.728534    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:29:52.733808 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.733782    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.736993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.736966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-00d34b-serving-cert\""
Sep 17 23:29:52.741455 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.741423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:29:52.824448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.824418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn5jh\" (UniqueName: \"kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.824640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.824465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.824640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.824497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.824640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.824564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.925375 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.925344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn5jh\" (UniqueName: \"kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.925598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.925584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.925691 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.925681    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.925819 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:29:52.925708    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-serving-cert: secret "maas-api-e2e-api-b-00d34b-serving-cert" not found
Sep 17 23:29:52.925913 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.925803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.926103 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:29:52.925904    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls podName:c86fc85a-7a5b-46fd-8a5e-ace15c914b57 nodeName:}" failed. No retries permitted until 2026-09-17 23:29:53.425886447 +0000 UTC m=+1432.304401671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls") pod "maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" (UID: "c86fc85a-7a5b-46fd-8a5e-ace15c914b57") : secret "maas-api-e2e-api-b-00d34b-serving-cert" not found
Sep 17 23:29:52.926460 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.926441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.928329 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.928309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:52.933304 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:52.933283    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn5jh\" (UniqueName: \"kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:53.396539 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.396498    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:53.397162 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.397128    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:53.431844 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.431808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:53.434670 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.434639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") pod \"maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:53.648744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.648656    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:53.947409 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:53.947376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:29:53.949527 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:29:53.949497    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86fc85a_7a5b_46fd_8a5e_ace15c914b57.slice/crio-08d91e85f965656eab537900323fabdb8c7d698a7432cd3f3e06f0a796e4c673 WatchSource:0}: Error finding container 08d91e85f965656eab537900323fabdb8c7d698a7432cd3f3e06f0a796e4c673: Status 404 returned error can't find the container with id 08d91e85f965656eab537900323fabdb8c7d698a7432cd3f3e06f0a796e4c673
Sep 17 23:29:54.288781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:54.288676    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" event={"ID":"c86fc85a-7a5b-46fd-8a5e-ace15c914b57","Type":"ContainerStarted","Data":"08d91e85f965656eab537900323fabdb8c7d698a7432cd3f3e06f0a796e4c673"}
Sep 17 23:29:54.395465 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:54.395429    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:54.395761 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:54.395725    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:55.299208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:55.299157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" event={"ID":"c86fc85a-7a5b-46fd-8a5e-ace15c914b57","Type":"ContainerStarted","Data":"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"}
Sep 17 23:29:55.300168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:55.300144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:29:55.318018 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:55.317964    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" podStartSLOduration=2.941213566 podStartE2EDuration="3.317948806s" totalImagesPullingTime="376.73524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:29:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:29:55.316309391 +0000 UTC m=+1434.194824639" watchObservedRunningTime="2026-09-17 23:29:55.317948806 +0000 UTC m=+1434.196464051"
Sep 17 23:29:55.395640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:55.395601    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:55.395827 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:55.395669    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:56.031519 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:56.031485    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:56.395305 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:56.395213    2581 patch_prober.go:28] interesting pod/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 17 23:29:56.395305 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:56.395294    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 17 23:29:57.398972 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:57.398944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:29:57.400026 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:29:57.400002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:30:02.318329 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:02.318302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:30:02.623898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:02.623809    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:30:02.624100 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:02.624073    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" podUID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" containerName="maas-api" containerID="cri-o://cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0" gracePeriod=30
Sep 17 23:30:03.098070 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.098033    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:30:03.237708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.237678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs\") pod \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") "
Sep 17 23:30:03.237948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.237716    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") pod \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") "
Sep 17 23:30:03.237948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.237759    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca\") pod \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") "
Sep 17 23:30:03.237948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.237816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqdwh\" (UniqueName: \"kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh\") pod \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\" (UID: \"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f\") "
Sep 17 23:30:03.238159 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.238132    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" (UID: "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:30:03.238268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.238251    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:03.239968 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.239939    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" (UID: "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:03.239968 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.239960    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" (UID: "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:03.240141 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.240018    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh" (OuterVolumeSpecName: "kube-api-access-nqdwh") pod "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" (UID: "a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f"). InnerVolumeSpecName "kube-api-access-nqdwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:03.339654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.339621    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqdwh\" (UniqueName: \"kubernetes.io/projected/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-kube-api-access-nqdwh\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:03.339654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.339649    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:03.339654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.339658    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:03.355132 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.355099    2581 generic.go:356] "Generic (PLEG): container finished" podID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" containerID="cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0" exitCode=0
Sep 17 23:30:03.355263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.355143    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"
Sep 17 23:30:03.355263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.355180    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" event={"ID":"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f","Type":"ContainerDied","Data":"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"}
Sep 17 23:30:03.355263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.355237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz" event={"ID":"a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f","Type":"ContainerDied","Data":"75de164ec425fb39368a9fa6ded311aea3a70be20bb5b4524c4d65df45b543af"}
Sep 17 23:30:03.355361 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.355265    2581 scope.go:117] "RemoveContainer" containerID="cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"
Sep 17 23:30:03.364916 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.364900    2581 scope.go:117] "RemoveContainer" containerID="cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"
Sep 17 23:30:03.365259 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:03.365238    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0\": container with ID starting with cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0 not found: ID does not exist" containerID="cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"
Sep 17 23:30:03.365336 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.365265    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0"} err="failed to get container status \"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0\": rpc error: code = NotFound desc = could not find container \"cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0\": container with ID starting with cf8b94496834ff68c5e505344ce37cbcd15aae429934c7c6ca6de5c29cc767f0 not found: ID does not exist"
Sep 17 23:30:03.376721 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.376701    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:30:03.380836 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.380816    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-0b4d93-777788f7cb-cw8pz"]
Sep 17 23:30:03.663186 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:03.663154    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" path="/var/lib/kubelet/pods/a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f/volumes"
Sep 17 23:30:06.422486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.422445    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" podUID="d94343a0-a04f-444f-8b71-74d444616218" containerName="main" containerID="cri-o://d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6" gracePeriod=45
Sep 17 23:30:06.680999 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.680941    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:30:06.772907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.772876    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.772907 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.772908    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.773155 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.773155 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773108    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9w9\" (UniqueName: \"kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.773155 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.773277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773188    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache\") pod \"d94343a0-a04f-444f-8b71-74d444616218\" (UID: \"d94343a0-a04f-444f-8b71-74d444616218\") "
Sep 17 23:30:06.773277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773200    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:06.773912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773451    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home" (OuterVolumeSpecName: "home") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:06.773912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773693    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-tmp-dir\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:06.773912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache" (OuterVolumeSpecName: "model-cache") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:06.773912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.773738    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-home\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:06.775299 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.775275    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:06.775379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.775341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9" (OuterVolumeSpecName: "kube-api-access-9t9w9") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "kube-api-access-9t9w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:06.775379 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.775346    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm" (OuterVolumeSpecName: "dshm") pod "d94343a0-a04f-444f-8b71-74d444616218" (UID: "d94343a0-a04f-444f-8b71-74d444616218"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:06.874574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.874543    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-dshm\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:06.874574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.874567    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9w9\" (UniqueName: \"kubernetes.io/projected/d94343a0-a04f-444f-8b71-74d444616218-kube-api-access-9t9w9\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:06.874574 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.874579    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d94343a0-a04f-444f-8b71-74d444616218-model-cache\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:06.874801 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:06.874588    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d94343a0-a04f-444f-8b71-74d444616218-tls-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:07.380147 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.380111    2581 generic.go:356] "Generic (PLEG): container finished" podID="d94343a0-a04f-444f-8b71-74d444616218" containerID="d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6" exitCode=0
Sep 17 23:30:07.380317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.380152    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"
Sep 17 23:30:07.380317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.380192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" event={"ID":"d94343a0-a04f-444f-8b71-74d444616218","Type":"ContainerDied","Data":"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"}
Sep 17 23:30:07.380317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.380237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4" event={"ID":"d94343a0-a04f-444f-8b71-74d444616218","Type":"ContainerDied","Data":"0cda87c69c8bfed6b9d281c01217ff3b07154649cda1ede40a63f542b72498b7"}
Sep 17 23:30:07.380317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.380256    2581 scope.go:117] "RemoveContainer" containerID="d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"
Sep 17 23:30:07.390103 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.390086    2581 scope.go:117] "RemoveContainer" containerID="d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"
Sep 17 23:30:07.390366 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:07.390344    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6\": container with ID starting with d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6 not found: ID does not exist" containerID="d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"
Sep 17 23:30:07.390424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.390375    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6"} err="failed to get container status \"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6\": rpc error: code = NotFound desc = could not find container \"d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6\": container with ID starting with d7d985b7644c28f80e095111ea9199c3bac46ad65ead4ef17e25e27e703ad7f6 not found: ID does not exist"
Sep 17 23:30:07.401235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.401212    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:30:07.404458 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.404437    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-0b4d93/distinct-w0-0b4d93-kserve-765bdfb7c-qbwt4"]
Sep 17 23:30:07.661784 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:07.661753    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d94343a0-a04f-444f-8b71-74d444616218" path="/var/lib/kubelet/pods/d94343a0-a04f-444f-8b71-74d444616218/volumes"
Sep 17 23:30:26.280188 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:26.280150    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:30:29.685028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:29.684190    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:30:29.685028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:29.684429    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" podUID="e891ba10-82ec-42c7-8777-4593ff352678" containerName="maas-api" containerID="cri-o://9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94" gracePeriod=30
Sep 17 23:30:30.017979 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.017946    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:30:30.118309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.117488    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs\") pod \"e891ba10-82ec-42c7-8777-4593ff352678\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") "
Sep 17 23:30:30.118309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.117575    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca\") pod \"e891ba10-82ec-42c7-8777-4593ff352678\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") "
Sep 17 23:30:30.118309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.117634    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls\") pod \"e891ba10-82ec-42c7-8777-4593ff352678\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") "
Sep 17 23:30:30.118309 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.117678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpqsl\" (UniqueName: \"kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl\") pod \"e891ba10-82ec-42c7-8777-4593ff352678\" (UID: \"e891ba10-82ec-42c7-8777-4593ff352678\") "
Sep 17 23:30:30.118733 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.118704    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e891ba10-82ec-42c7-8777-4593ff352678" (UID: "e891ba10-82ec-42c7-8777-4593ff352678"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:30:30.121113 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.121065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e891ba10-82ec-42c7-8777-4593ff352678" (UID: "e891ba10-82ec-42c7-8777-4593ff352678"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:30.123857 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.123819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl" (OuterVolumeSpecName: "kube-api-access-wpqsl") pod "e891ba10-82ec-42c7-8777-4593ff352678" (UID: "e891ba10-82ec-42c7-8777-4593ff352678"). InnerVolumeSpecName "kube-api-access-wpqsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:30.124937 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.124902    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e891ba10-82ec-42c7-8777-4593ff352678" (UID: "e891ba10-82ec-42c7-8777-4593ff352678"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:30.218898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.218852    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:30.218898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.218887    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e891ba10-82ec-42c7-8777-4593ff352678-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:30.218898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.218900    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e891ba10-82ec-42c7-8777-4593ff352678-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:30.218898 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.218909    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpqsl\" (UniqueName: \"kubernetes.io/projected/e891ba10-82ec-42c7-8777-4593ff352678-kube-api-access-wpqsl\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:30.513035 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.512990    2581 generic.go:356] "Generic (PLEG): container finished" podID="e891ba10-82ec-42c7-8777-4593ff352678" containerID="9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94" exitCode=0
Sep 17 23:30:30.513263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.513097    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"
Sep 17 23:30:30.513263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.513098    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" event={"ID":"e891ba10-82ec-42c7-8777-4593ff352678","Type":"ContainerDied","Data":"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"}
Sep 17 23:30:30.513263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.513194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9" event={"ID":"e891ba10-82ec-42c7-8777-4593ff352678","Type":"ContainerDied","Data":"f7147b975e2e6744b5bc509109a6cf472945057011d19707747c28a8785c83ba"}
Sep 17 23:30:30.513263 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.513227    2581 scope.go:117] "RemoveContainer" containerID="9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"
Sep 17 23:30:30.523532 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.523514    2581 scope.go:117] "RemoveContainer" containerID="9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"
Sep 17 23:30:30.523785 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:30.523765    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94\": container with ID starting with 9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94 not found: ID does not exist" containerID="9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"
Sep 17 23:30:30.523851 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.523798    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94"} err="failed to get container status \"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94\": rpc error: code = NotFound desc = could not find container \"9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94\": container with ID starting with 9754d1fcc56baea434fa3a28d4da03a0ad99754942d355a20c78df95445e3f94 not found: ID does not exist"
Sep 17 23:30:30.539317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.539295    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:30:30.545931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:30.545907    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-eb0661-69bd864498-wwfh9"]
Sep 17 23:30:31.662357 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:31.662320    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e891ba10-82ec-42c7-8777-4593ff352678" path="/var/lib/kubelet/pods/e891ba10-82ec-42c7-8777-4593ff352678/volumes"
Sep 17 23:30:36.658510 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:36.658480    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:30:36.658969 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:36.658741    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy" containerID="cri-o://c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165" gracePeriod=30
Sep 17 23:30:37.553348 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.553322    2581 generic.go:356] "Generic (PLEG): container finished" podID="be33632c-b09a-4e81-b967-9defe363eff0" containerID="6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52" exitCode=0
Sep 17 23:30:37.553530 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.553397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerDied","Data":"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"}
Sep 17 23:30:37.553842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.553826    2581 scope.go:117] "RemoveContainer" containerID="6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"
Sep 17 23:30:37.555005 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.554971    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:30:37.555113 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.555041    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:30:37.555113 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:37.555093    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:30:38.561576 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:38.561546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerStarted","Data":"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"}
Sep 17 23:30:39.034806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:39.034357    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:30:39.034806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:39.034487    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:39.034806 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:39.034531    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:40.034640 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:40.034604    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:40.035028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:40.034659    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:41.033827 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:41.033788    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:41.034005 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:41.033846    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:41.958555 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:41.958528    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:30:42.033986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.033947    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:42.034175 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.034013    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:42.146439 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlznb\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146447    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146542    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146651    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146760    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token\") pod \"92162ff9-ad90-4e54-832a-fe5f243e83db\" (UID: \"92162ff9-ad90-4e54-832a-fe5f243e83db\") "
Sep 17 23:30:42.146956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:42.146956 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.146863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data" (OuterVolumeSpecName: "istio-data") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147078    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147170    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147187    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147190    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:30:42.147245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.147201    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.148862 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.148830    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:30:42.148978 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.148866    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:30:42.149177 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.149156    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb" (OuterVolumeSpecName: "kube-api-access-vlznb") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "kube-api-access-vlznb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:42.149282 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.149267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token" (OuterVolumeSpecName: "istio-token") pod "92162ff9-ad90-4e54-832a-fe5f243e83db" (UID: "92162ff9-ad90-4e54-832a-fe5f243e83db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248090    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248121    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248130    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248138    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92162ff9-ad90-4e54-832a-fe5f243e83db-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248145    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.248181 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.248153    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlznb\" (UniqueName: \"kubernetes.io/projected/92162ff9-ad90-4e54-832a-fe5f243e83db-kube-api-access-vlznb\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:42.590111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.589994    2581 generic.go:356] "Generic (PLEG): container finished" podID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerID="c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165" exitCode=0
Sep 17 23:30:42.590278 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.590164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerDied","Data":"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"}
Sep 17 23:30:42.590278 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.590218    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n" event={"ID":"92162ff9-ad90-4e54-832a-fe5f243e83db","Type":"ContainerDied","Data":"14638a387503ad3e282c64cf5893acad8575422df72dbde1f491034af01c0800"}
Sep 17 23:30:42.590278 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.590249    2581 scope.go:117] "RemoveContainer" containerID="c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"
Sep 17 23:30:42.590454 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.590416    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"
Sep 17 23:30:42.614226 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.614203    2581 scope.go:117] "RemoveContainer" containerID="5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"
Sep 17 23:30:42.623008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.622988    2581 scope.go:117] "RemoveContainer" containerID="c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"
Sep 17 23:30:42.623337 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:42.623314    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165\": container with ID starting with c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165 not found: ID does not exist" containerID="c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"
Sep 17 23:30:42.623420 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.623345    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165"} err="failed to get container status \"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165\": rpc error: code = NotFound desc = could not find container \"c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165\": container with ID starting with c30bc9e9202020dc72e109490dc1b5b100a1a8f7c12298f61e19bfdeb1bc2165 not found: ID does not exist"
Sep 17 23:30:42.623420 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.623363    2581 scope.go:117] "RemoveContainer" containerID="5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"
Sep 17 23:30:42.623654 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:42.623632    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8\": container with ID starting with 5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8 not found: ID does not exist" containerID="5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"
Sep 17 23:30:42.623696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.623663    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8"} err="failed to get container status \"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8\": rpc error: code = NotFound desc = could not find container \"5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8\": container with ID starting with 5a0c4fd78fd8b8fa0ad48d3c28bcaf5db0261abf55ca389269bbf616a2c100d8 not found: ID does not exist"
Sep 17 23:30:42.627517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.627493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:30:42.631241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:42.631214    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-eb0661-openshift-default-6dfb7ff98d-58b9n"]
Sep 17 23:30:43.034007 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:43.033967    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:43.034411 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:43.034039    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:43.660870 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:43.660840    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" path="/var/lib/kubelet/pods/92162ff9-ad90-4e54-832a-fe5f243e83db/volumes"
Sep 17 23:30:44.034342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:44.034263    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 17 23:30:44.034342 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:44.034316    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 17 23:30:45.038383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:45.038348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:30:45.038873 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:45.038854    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:30:45.039586 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:45.039566    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:30:52.600652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.600621    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:30:52.601090 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.600815    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" podUID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" containerName="maas-api" containerID="cri-o://9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33" gracePeriod=30
Sep 17 23:30:52.847974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.847950    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:30:52.951559 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.951531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca\") pod \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") "
Sep 17 23:30:52.951748 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.951614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") pod \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") "
Sep 17 23:30:52.951826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.951762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nn5jh\" (UniqueName: \"kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh\") pod \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") "
Sep 17 23:30:52.951826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.951795    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs\") pod \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\" (UID: \"c86fc85a-7a5b-46fd-8a5e-ace15c914b57\") "
Sep 17 23:30:52.952120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.951952    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c86fc85a-7a5b-46fd-8a5e-ace15c914b57" (UID: "c86fc85a-7a5b-46fd-8a5e-ace15c914b57"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:30:52.952233 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.952202    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:52.953925 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.953899    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c86fc85a-7a5b-46fd-8a5e-ace15c914b57" (UID: "c86fc85a-7a5b-46fd-8a5e-ace15c914b57"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:52.954329 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.954309    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c86fc85a-7a5b-46fd-8a5e-ace15c914b57" (UID: "c86fc85a-7a5b-46fd-8a5e-ace15c914b57"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:30:52.954430 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:52.954330    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh" (OuterVolumeSpecName: "kube-api-access-nn5jh") pod "c86fc85a-7a5b-46fd-8a5e-ace15c914b57" (UID: "c86fc85a-7a5b-46fd-8a5e-ace15c914b57"). InnerVolumeSpecName "kube-api-access-nn5jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:30:53.052974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.052937    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:53.052974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.052969    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nn5jh\" (UniqueName: \"kubernetes.io/projected/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-kube-api-access-nn5jh\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:53.052974 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.052985    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c86fc85a-7a5b-46fd-8a5e-ace15c914b57-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:30:53.656274 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.656229    2581 generic.go:356] "Generic (PLEG): container finished" podID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" containerID="9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33" exitCode=0
Sep 17 23:30:53.656684 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.656341    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"
Sep 17 23:30:53.663097 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.663072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" event={"ID":"c86fc85a-7a5b-46fd-8a5e-ace15c914b57","Type":"ContainerDied","Data":"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"}
Sep 17 23:30:53.663221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.663112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v" event={"ID":"c86fc85a-7a5b-46fd-8a5e-ace15c914b57","Type":"ContainerDied","Data":"08d91e85f965656eab537900323fabdb8c7d698a7432cd3f3e06f0a796e4c673"}
Sep 17 23:30:53.663221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.663132    2581 scope.go:117] "RemoveContainer" containerID="9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"
Sep 17 23:30:53.672692 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.672678    2581 scope.go:117] "RemoveContainer" containerID="9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"
Sep 17 23:30:53.672954 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:30:53.672936    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33\": container with ID starting with 9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33 not found: ID does not exist" containerID="9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"
Sep 17 23:30:53.672997 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.672963    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33"} err="failed to get container status \"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33\": rpc error: code = NotFound desc = could not find container \"9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33\": container with ID starting with 9cb749934e5f1913ab848e4a3bd9b83c94a8e7bd8c07adc2f66030c9631cbc33 not found: ID does not exist"
Sep 17 23:30:53.679910 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.679888    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:30:53.682601 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:53.682580    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-00d34b-75cc5bbb54-98q7v"]
Sep 17 23:30:54.401751 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:54.401717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:30:55.660565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:55.660534    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" path="/var/lib/kubelet/pods/c86fc85a-7a5b-46fd-8a5e-ace15c914b57/volumes"
Sep 17 23:30:59.290511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:59.290474    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:30:59.291028 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:30:59.290726    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" containerID="cri-o://ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae" gracePeriod=30
Sep 17 23:31:00.041780 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:00.041745    2581 patch_prober.go:28] interesting pod/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:31:00.041961 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:00.041814    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:31:01.690520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:01.690484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:31:01.693517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:01.693495    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:31:04.556708 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.556646    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:31:04.659254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m6bf\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659288    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659445 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659428    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659477    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659524    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:04.659677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659541    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:04.659887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659717    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert\") pod \"be33632c-b09a-4e81-b967-9defe363eff0\" (UID: \"be33632c-b09a-4e81-b967-9defe363eff0\") "
Sep 17 23:31:04.659887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659756    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data" (OuterVolumeSpecName: "istio-data") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:04.659887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.659767    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:04.660143 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.660014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:04.660143 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.660130    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.660222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.660152    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.660222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.660166    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.660222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.660178    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.661541 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.661518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf" (OuterVolumeSpecName: "kube-api-access-2m6bf") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "kube-api-access-2m6bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:04.661713 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.661698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token" (OuterVolumeSpecName: "istio-token") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:04.661910 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.661885    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:31:04.661984 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.661931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be33632c-b09a-4e81-b967-9defe363eff0" (UID: "be33632c-b09a-4e81-b967-9defe363eff0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:04.714291 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.714261    2581 generic.go:356] "Generic (PLEG): container finished" podID="be33632c-b09a-4e81-b967-9defe363eff0" containerID="ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae" exitCode=0
Sep 17 23:31:04.714447 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.714304    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"
Sep 17 23:31:04.714447 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.714343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerDied","Data":"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"}
Sep 17 23:31:04.714447 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.714404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq" event={"ID":"be33632c-b09a-4e81-b967-9defe363eff0","Type":"ContainerDied","Data":"71a81482178c8c5e0a756c2e91ec33f75bbd2c97907b4ca0fb9a639a2a7ab530"}
Sep 17 23:31:04.714447 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.714433    2581 scope.go:117] "RemoveContainer" containerID="ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"
Sep 17 23:31:04.723689 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.723674    2581 scope.go:117] "RemoveContainer" containerID="6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"
Sep 17 23:31:04.731975 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.731957    2581 scope.go:117] "RemoveContainer" containerID="ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"
Sep 17 23:31:04.732271 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:04.732248    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae\": container with ID starting with ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae not found: ID does not exist" containerID="ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"
Sep 17 23:31:04.732350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.732284    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae"} err="failed to get container status \"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae\": rpc error: code = NotFound desc = could not find container \"ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae\": container with ID starting with ef505908b13eec744b47595ef46c2a67dc088a493949ce744598302aa62f3eae not found: ID does not exist"
Sep 17 23:31:04.732350 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.732307    2581 scope.go:117] "RemoveContainer" containerID="6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"
Sep 17 23:31:04.732569 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:04.732547    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52\": container with ID starting with 6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52 not found: ID does not exist" containerID="6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"
Sep 17 23:31:04.732661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.732573    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52"} err="failed to get container status \"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52\": rpc error: code = NotFound desc = could not find container \"6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52\": container with ID starting with 6879a7eea9e33e414a67d9998d617d17e781586886476286fbb18f6cd9be8e52 not found: ID does not exist"
Sep 17 23:31:04.736303 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.736282    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:31:04.742551 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.742530    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-00d34b-openshift-default-5bdc5688f6-lzxkq"]
Sep 17 23:31:04.760856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.760835    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be33632c-b09a-4e81-b967-9defe363eff0-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.760856 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.760853    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m6bf\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-kube-api-access-2m6bf\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.760982 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.760863    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be33632c-b09a-4e81-b967-9defe363eff0-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.760982 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.760873    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be33632c-b09a-4e81-b967-9defe363eff0-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:04.760982 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:04.760881    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be33632c-b09a-4e81-b967-9defe363eff0-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:05.660744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:05.660712    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be33632c-b09a-4e81-b967-9defe363eff0" path="/var/lib/kubelet/pods/be33632c-b09a-4e81-b967-9defe363eff0/volumes"
Sep 17 23:31:10.041292 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.041251    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:31:10.041699 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.041524    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" podUID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" containerName="maas-api" containerID="cri-o://bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24" gracePeriod=30
Sep 17 23:31:10.294744 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.294685    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:31:10.412998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.412965    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs\") pod \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") "
Sep 17 23:31:10.413205 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.413035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n68d5\" (UniqueName: \"kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5\") pod \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") "
Sep 17 23:31:10.413285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.413229    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls\") pod \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") "
Sep 17 23:31:10.413285 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.413262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca\") pod \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\" (UID: \"e7ab2514-a5ad-4bb8-bee6-803f30a806ba\") "
Sep 17 23:31:10.413730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.413698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7ab2514-a5ad-4bb8-bee6-803f30a806ba" (UID: "e7ab2514-a5ad-4bb8-bee6-803f30a806ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:10.415275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.415251    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5" (OuterVolumeSpecName: "kube-api-access-n68d5") pod "e7ab2514-a5ad-4bb8-bee6-803f30a806ba" (UID: "e7ab2514-a5ad-4bb8-bee6-803f30a806ba"). InnerVolumeSpecName "kube-api-access-n68d5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:10.415275 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.415262    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e7ab2514-a5ad-4bb8-bee6-803f30a806ba" (UID: "e7ab2514-a5ad-4bb8-bee6-803f30a806ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:10.415626 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.415608    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7ab2514-a5ad-4bb8-bee6-803f30a806ba" (UID: "e7ab2514-a5ad-4bb8-bee6-803f30a806ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:10.514245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.514212    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:10.514245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.514243    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:10.514245 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.514253    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:10.514489 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.514264    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n68d5\" (UniqueName: \"kubernetes.io/projected/e7ab2514-a5ad-4bb8-bee6-803f30a806ba-kube-api-access-n68d5\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:10.747636 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.747601    2581 generic.go:356] "Generic (PLEG): container finished" podID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" containerID="bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24" exitCode=0
Sep 17 23:31:10.747835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.747653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"
Sep 17 23:31:10.747835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.747671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" event={"ID":"e7ab2514-a5ad-4bb8-bee6-803f30a806ba","Type":"ContainerDied","Data":"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"}
Sep 17 23:31:10.747835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.747710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj" event={"ID":"e7ab2514-a5ad-4bb8-bee6-803f30a806ba","Type":"ContainerDied","Data":"eb0859229f777a9db4845c76fb72e301be6a1342e6386c6129ad2059717be1ed"}
Sep 17 23:31:10.747835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.747731    2581 scope.go:117] "RemoveContainer" containerID="bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"
Sep 17 23:31:10.757975 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.757956    2581 scope.go:117] "RemoveContainer" containerID="bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"
Sep 17 23:31:10.758265 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:10.758246    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24\": container with ID starting with bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24 not found: ID does not exist" containerID="bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"
Sep 17 23:31:10.758332 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.758274    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24"} err="failed to get container status \"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24\": rpc error: code = NotFound desc = could not find container \"bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24\": container with ID starting with bec7034f5b7e7255a71daf7136338ac971ccc153463094b0627b85bf6525ce24 not found: ID does not exist"
Sep 17 23:31:10.769541 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.769521    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:31:10.773216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:10.773196    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-09c1c1-7b8b9d9d98-69fnj"]
Sep 17 23:31:11.662374 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:11.662340    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" path="/var/lib/kubelet/pods/e7ab2514-a5ad-4bb8-bee6-803f30a806ba/volumes"
Sep 17 23:31:12.734320 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:12.734286    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:31:12.734825 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:12.734569    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" podUID="418fb916-9441-4145-9d12-902dc2e72b2f" containerName="maas-api" containerID="cri-o://2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3" gracePeriod=30
Sep 17 23:31:13.180114 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.180091    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:31:13.341773 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.341700    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vg72s\" (UniqueName: \"kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s\") pod \"418fb916-9441-4145-9d12-902dc2e72b2f\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") "
Sep 17 23:31:13.341914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.341801    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls\") pod \"418fb916-9441-4145-9d12-902dc2e72b2f\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") "
Sep 17 23:31:13.341914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.341835    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs\") pod \"418fb916-9441-4145-9d12-902dc2e72b2f\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") "
Sep 17 23:31:13.341914 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.341866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca\") pod \"418fb916-9441-4145-9d12-902dc2e72b2f\" (UID: \"418fb916-9441-4145-9d12-902dc2e72b2f\") "
Sep 17 23:31:13.342317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.342286    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "418fb916-9441-4145-9d12-902dc2e72b2f" (UID: "418fb916-9441-4145-9d12-902dc2e72b2f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:13.343893 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.343860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "418fb916-9441-4145-9d12-902dc2e72b2f" (UID: "418fb916-9441-4145-9d12-902dc2e72b2f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:13.343994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.343906    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s" (OuterVolumeSpecName: "kube-api-access-vg72s") pod "418fb916-9441-4145-9d12-902dc2e72b2f" (UID: "418fb916-9441-4145-9d12-902dc2e72b2f"). InnerVolumeSpecName "kube-api-access-vg72s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:13.343994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.343909    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "418fb916-9441-4145-9d12-902dc2e72b2f" (UID: "418fb916-9441-4145-9d12-902dc2e72b2f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:13.443476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.443442    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:13.443476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.443470    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/418fb916-9441-4145-9d12-902dc2e72b2f-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:13.443476 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.443482    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/418fb916-9441-4145-9d12-902dc2e72b2f-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:13.443677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.443495    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vg72s\" (UniqueName: \"kubernetes.io/projected/418fb916-9441-4145-9d12-902dc2e72b2f-kube-api-access-vg72s\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:13.767490 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.767457    2581 generic.go:356] "Generic (PLEG): container finished" podID="418fb916-9441-4145-9d12-902dc2e72b2f" containerID="2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3" exitCode=0
Sep 17 23:31:13.767878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.767507    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"
Sep 17 23:31:13.767878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.767532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" event={"ID":"418fb916-9441-4145-9d12-902dc2e72b2f","Type":"ContainerDied","Data":"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"}
Sep 17 23:31:13.767878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.767579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth" event={"ID":"418fb916-9441-4145-9d12-902dc2e72b2f","Type":"ContainerDied","Data":"1eb17101b671e86dbdc66725fd752fd44e18f9baaf6edcc309305bbcdfb246a8"}
Sep 17 23:31:13.767878 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.767602    2581 scope.go:117] "RemoveContainer" containerID="2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"
Sep 17 23:31:13.776226 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.776208    2581 scope.go:117] "RemoveContainer" containerID="2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"
Sep 17 23:31:13.776488 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:13.776471    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3\": container with ID starting with 2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3 not found: ID does not exist" containerID="2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"
Sep 17 23:31:13.776564 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.776496    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3"} err="failed to get container status \"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3\": rpc error: code = NotFound desc = could not find container \"2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3\": container with ID starting with 2be4383c0e892af5087c26f420245bdb76b200762edb2f2632f0e80e32a50ff3 not found: ID does not exist"
Sep 17 23:31:13.783500 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.783465    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:31:13.789269 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:13.789248    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7ab633-879c864cb-9nsth"]
Sep 17 23:31:15.661600 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:15.661559    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="418fb916-9441-4145-9d12-902dc2e72b2f" path="/var/lib/kubelet/pods/418fb916-9441-4145-9d12-902dc2e72b2f/volumes"
Sep 17 23:31:17.029622 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:17.029589    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:31:17.030104 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:17.029796    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" containerID="cri-o://4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca" gracePeriod=30
Sep 17 23:31:17.883073 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:17.883014    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:31:17.883250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:17.883099    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:31:18.843998 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:18.843962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:31:22.284826 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.284795    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:31:22.431993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.431960    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432006    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqwvk\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432227 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432214    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432240    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432277    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432505 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo\") pod \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\" (UID: \"9bfc1285-69d8-4e0c-a661-c7af6e671e0a\") "
Sep 17 23:31:22.432661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432479    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:22.432661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432508    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:22.432661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:22.432661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432550    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:22.432852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:22.432852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432764    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.432852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432785    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.432852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432802    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.432852 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.432815    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.434496 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.434470    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk" (OuterVolumeSpecName: "kube-api-access-xqwvk") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "kube-api-access-xqwvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:22.434496 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.434487    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:22.434777 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.434758    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:22.434838 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.434761    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bfc1285-69d8-4e0c-a661-c7af6e671e0a" (UID: "9bfc1285-69d8-4e0c-a661-c7af6e671e0a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:31:22.534199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.534166    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.534199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.534193    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.534199 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.534202    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqwvk\" (UniqueName: \"kubernetes.io/projected/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-kube-api-access-xqwvk\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.534421 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.534210    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.534421 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.534220    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bfc1285-69d8-4e0c-a661-c7af6e671e0a-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:22.820489 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.820406    2581 generic.go:356] "Generic (PLEG): container finished" podID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerID="4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca" exitCode=0
Sep 17 23:31:22.820489 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.820459    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"
Sep 17 23:31:22.820489 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.820468    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerDied","Data":"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"}
Sep 17 23:31:22.820712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.820522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4" event={"ID":"9bfc1285-69d8-4e0c-a661-c7af6e671e0a","Type":"ContainerDied","Data":"d88ad8e05011aea0525d17be01aa67b5f190ea4ab0778520929896a1e5af950c"}
Sep 17 23:31:22.820712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.820552    2581 scope.go:117] "RemoveContainer" containerID="4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"
Sep 17 23:31:22.830037 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.830018    2581 scope.go:117] "RemoveContainer" containerID="2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"
Sep 17 23:31:22.837849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.837827    2581 scope.go:117] "RemoveContainer" containerID="4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"
Sep 17 23:31:22.838166 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:22.838144    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca\": container with ID starting with 4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca not found: ID does not exist" containerID="4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"
Sep 17 23:31:22.838222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.838176    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca"} err="failed to get container status \"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca\": rpc error: code = NotFound desc = could not find container \"4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca\": container with ID starting with 4b5723cfd790ffea7680e38959a6752ea9bfe0f33ce8e2caac333d23b39fcaca not found: ID does not exist"
Sep 17 23:31:22.838222 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.838192    2581 scope.go:117] "RemoveContainer" containerID="2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"
Sep 17 23:31:22.838453 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:22.838436    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd\": container with ID starting with 2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd not found: ID does not exist" containerID="2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"
Sep 17 23:31:22.838517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.838458    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd"} err="failed to get container status \"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd\": rpc error: code = NotFound desc = could not find container \"2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd\": container with ID starting with 2ad2f59523540d96da89ed77f9949b1a8af1fb0a4a7dd345a4d421a67d7a1abd not found: ID does not exist"
Sep 17 23:31:22.841503 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.841475    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:31:22.845116 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:22.845093    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-09c1c1-openshift-default-6fcc7945cb-r9rp4"]
Sep 17 23:31:23.660924 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:23.660891    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" path="/var/lib/kubelet/pods/9bfc1285-69d8-4e0c-a661-c7af6e671e0a/volumes"
Sep 17 23:31:27.829353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:27.829320    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:31:27.829747 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:27.829546    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" podUID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" containerName="maas-api" containerID="cri-o://81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e" gracePeriod=30
Sep 17 23:31:28.076654 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.076626    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:31:28.083241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083178    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwm5b\" (UniqueName: \"kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b\") pod \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") "
Sep 17 23:31:28.083241 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") pod \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") "
Sep 17 23:31:28.083432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083245    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca\") pod \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") "
Sep 17 23:31:28.083432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083345    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs\") pod \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\" (UID: \"3bdaca07-64bf-47ae-b7ae-b57d43fde53d\") "
Sep 17 23:31:28.083595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083570    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bdaca07-64bf-47ae-b7ae-b57d43fde53d" (UID: "3bdaca07-64bf-47ae-b7ae-b57d43fde53d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:28.083687 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.083670    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:28.085426 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.085401    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bdaca07-64bf-47ae-b7ae-b57d43fde53d" (UID: "3bdaca07-64bf-47ae-b7ae-b57d43fde53d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:28.085528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.085446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3bdaca07-64bf-47ae-b7ae-b57d43fde53d" (UID: "3bdaca07-64bf-47ae-b7ae-b57d43fde53d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:31:28.085528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.085449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b" (OuterVolumeSpecName: "kube-api-access-kwm5b") pod "3bdaca07-64bf-47ae-b7ae-b57d43fde53d" (UID: "3bdaca07-64bf-47ae-b7ae-b57d43fde53d"). InnerVolumeSpecName "kube-api-access-kwm5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:28.185172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.185137    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwm5b\" (UniqueName: \"kubernetes.io/projected/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-kube-api-access-kwm5b\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:28.185172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.185167    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:28.185172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.185176    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3bdaca07-64bf-47ae-b7ae-b57d43fde53d-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:28.854971 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.854938    2581 generic.go:356] "Generic (PLEG): container finished" podID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" containerID="81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e" exitCode=0
Sep 17 23:31:28.855382 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.854983    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"
Sep 17 23:31:28.855382 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.855026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" event={"ID":"3bdaca07-64bf-47ae-b7ae-b57d43fde53d","Type":"ContainerDied","Data":"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"}
Sep 17 23:31:28.855382 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.855089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz" event={"ID":"3bdaca07-64bf-47ae-b7ae-b57d43fde53d","Type":"ContainerDied","Data":"003b1792c12f6bd0e6207a151bc03030799d7d494cdf8b43045a68eba9acfd60"}
Sep 17 23:31:28.855382 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.855112    2581 scope.go:117] "RemoveContainer" containerID="81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"
Sep 17 23:31:28.864863 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.864843    2581 scope.go:117] "RemoveContainer" containerID="81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"
Sep 17 23:31:28.865148 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:31:28.865131    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e\": container with ID starting with 81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e not found: ID does not exist" containerID="81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"
Sep 17 23:31:28.865220 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.865157    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e"} err="failed to get container status \"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e\": rpc error: code = NotFound desc = could not find container \"81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e\": container with ID starting with 81df20438e37d8ce3062f912e8ba0ffaf0c1c13c87a7170712154b3cf724006e not found: ID does not exist"
Sep 17 23:31:28.893154 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.893126    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:31:28.897515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:28.897491    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55130c-585c8b4b97-xcmjz"]
Sep 17 23:31:29.661201 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:29.661170    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" path="/var/lib/kubelet/pods/3bdaca07-64bf-47ae-b7ae-b57d43fde53d/volumes"
Sep 17 23:31:34.793410 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:34.793367    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:31:34.793904 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:34.793634    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" containerID="cri-o://743d925cab1ec489ef8706a52849f37c53245d878156183a0a72eb6d568b79b7" gracePeriod=30
Sep 17 23:31:35.845515 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:35.845483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:31:37.951032 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:37.950992    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 23:31:37.951430 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:37.951089    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 23:31:39.914964 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:39.914926    2581 generic.go:356] "Generic (PLEG): container finished" podID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerID="743d925cab1ec489ef8706a52849f37c53245d878156183a0a72eb6d568b79b7" exitCode=0
Sep 17 23:31:39.915355 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:39.915001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerDied","Data":"743d925cab1ec489ef8706a52849f37c53245d878156183a0a72eb6d568b79b7"}
Sep 17 23:31:39.915355 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:39.915086    2581 scope.go:117] "RemoveContainer" containerID="a96ee4fde9f4d325064ca4a294a411290211d5768793cc07a35cb8fe904632aa"
Sep 17 23:31:40.056838 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.056776    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:31:40.088395 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088429    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088528    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088587 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088562    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088693    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:40.088941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7f8\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8\") pod \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\" (UID: \"4344ed18-35c9-46d4-bc69-6b2dfe67e82a\") "
Sep 17 23:31:40.088941 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.088903    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:40.089228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.089014    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:40.089228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.089079    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.089228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.089100    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.089228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.089139    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:31:40.089485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.089459    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:40.090794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.090764    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:40.090955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.090937    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8" (OuterVolumeSpecName: "kube-api-access-dr7f8") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "kube-api-access-dr7f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:31:40.091017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.090983    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:31:40.091456 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.091430    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4344ed18-35c9-46d4-bc69-6b2dfe67e82a" (UID: "4344ed18-35c9-46d4-bc69-6b2dfe67e82a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:31:40.190293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190250    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190280    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190290    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7f8\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-kube-api-access-dr7f8\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190302    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190567 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190310    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190567 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190317    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.190567 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.190325    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4344ed18-35c9-46d4-bc69-6b2dfe67e82a-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:31:40.921512 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.921482    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"
Sep 17 23:31:40.921935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.921524    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n" event={"ID":"4344ed18-35c9-46d4-bc69-6b2dfe67e82a","Type":"ContainerDied","Data":"4e1d3a87c63bec795708a6d3b165c00399a7b8c52691d8a88b0a03f426a023b0"}
Sep 17 23:31:40.921935 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.921575    2581 scope.go:117] "RemoveContainer" containerID="743d925cab1ec489ef8706a52849f37c53245d878156183a0a72eb6d568b79b7"
Sep 17 23:31:40.945129 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.945096    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:31:40.952069 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:40.952029    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-55130c-openshift-default-55b844f76b-h8p2n"]
Sep 17 23:31:41.661807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:41.661777    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" path="/var/lib/kubelet/pods/4344ed18-35c9-46d4-bc69-6b2dfe67e82a/volumes"
Sep 17 23:31:52.136084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:31:52.136032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:32:03.134117 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:03.134079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:32:04.888596 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888562    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-9d0d6f"]
Sep 17 23:32:04.888950 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888931    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:32:04.888950 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888942    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:32:04.888950 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888949    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888955    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888963    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d94343a0-a04f-444f-8b71-74d444616218" containerName="main"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888969    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d94343a0-a04f-444f-8b71-74d444616218" containerName="main"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888979    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888984    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.888995    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889000    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889008    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889013    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889020    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889025    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889034    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889040    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889059    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889064    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889072    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889080    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889087    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889092    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889099    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="418fb916-9441-4145-9d12-902dc2e72b2f" containerName="maas-api"
Sep 17 23:32:04.889096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889104    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="418fb916-9441-4145-9d12-902dc2e72b2f" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889117    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889122    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889129    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889134    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889139    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e891ba10-82ec-42c7-8777-4593ff352678" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889143    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e891ba10-82ec-42c7-8777-4593ff352678" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889198    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e891ba10-82ec-42c7-8777-4593ff352678" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889206    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8eb847f-1430-42d1-9e87-6c8b7a3f8d0f" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889212    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7ab2514-a5ad-4bb8-bee6-803f30a806ba" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889218    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889223    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86fc85a-7a5b-46fd-8a5e-ace15c914b57" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889227    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d94343a0-a04f-444f-8b71-74d444616218" containerName="main"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889233    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889239    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889244    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="418fb916-9441-4145-9d12-902dc2e72b2f" containerName="maas-api"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889249    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889254    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4344ed18-35c9-46d4-bc69-6b2dfe67e82a" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889273    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="92162ff9-ad90-4e54-832a-fe5f243e83db" containerName="istio-proxy"
Sep 17 23:32:04.889716 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.889280    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bdaca07-64bf-47ae-b7ae-b57d43fde53d" containerName="maas-api"
Sep 17 23:32:04.892229 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.892213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:04.894531 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.894514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8nhtg\""
Sep 17 23:32:04.899860 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:04.899838    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-9d0d6f"]
Sep 17 23:32:05.018518 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:05.018489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7cm5\" (UniqueName: \"kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5\") pod \"test-curl-7638-9d0d6f\" (UID: \"18bcb919-1645-4962-853d-f323fe3f76ed\") " pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:05.119303 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:05.119271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7cm5\" (UniqueName: \"kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5\") pod \"test-curl-7638-9d0d6f\" (UID: \"18bcb919-1645-4962-853d-f323fe3f76ed\") " pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:05.126842 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:05.126820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7cm5\" (UniqueName: \"kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5\") pod \"test-curl-7638-9d0d6f\" (UID: \"18bcb919-1645-4962-853d-f323fe3f76ed\") " pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:05.203116 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:05.203091    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:05.474920 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:05.474894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-9d0d6f"]
Sep 17 23:32:05.477084 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:32:05.477034    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18bcb919_1645_4962_853d_f323fe3f76ed.slice/crio-04acdf44bdcb0b0ed3fb3383e67d62c522c2911a7ab1da9d41a89b55ecded6f9 WatchSource:0}: Error finding container 04acdf44bdcb0b0ed3fb3383e67d62c522c2911a7ab1da9d41a89b55ecded6f9: Status 404 returned error can't find the container with id 04acdf44bdcb0b0ed3fb3383e67d62c522c2911a7ab1da9d41a89b55ecded6f9
Sep 17 23:32:06.059940 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:06.059901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-9d0d6f" event={"ID":"18bcb919-1645-4962-853d-f323fe3f76ed","Type":"ContainerStarted","Data":"1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94"}
Sep 17 23:32:06.060471 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:06.059950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-9d0d6f" event={"ID":"18bcb919-1645-4962-853d-f323fe3f76ed","Type":"ContainerStarted","Data":"04acdf44bdcb0b0ed3fb3383e67d62c522c2911a7ab1da9d41a89b55ecded6f9"}
Sep 17 23:32:06.074524 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:06.074479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-9d0d6f" podStartSLOduration=2.074465464 podStartE2EDuration="2.074465464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:32:06.072262178 +0000 UTC m=+1564.950777436" watchObservedRunningTime="2026-09-17 23:32:06.074465464 +0000 UTC m=+1564.952980710"
Sep 17 23:32:06.672080 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:06.672030    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-9d0d6f"]
Sep 17 23:32:06.675722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:06.675698    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-9d0d6f"]
Sep 17 23:32:07.064964 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:32:07.064936    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-9d0d6f" container="test-curl-7638-9d0d6f"
Sep 17 23:32:08.069137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:08.069097    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-9d0d6f" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" containerName="test-curl-7638-9d0d6f" containerID="cri-o://1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94" gracePeriod=2
Sep 17 23:32:10.227904 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:10.227883    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:10.366660 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:10.366591    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7cm5\" (UniqueName: \"kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5\") pod \"18bcb919-1645-4962-853d-f323fe3f76ed\" (UID: \"18bcb919-1645-4962-853d-f323fe3f76ed\") "
Sep 17 23:32:10.368567 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:10.368539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5" (OuterVolumeSpecName: "kube-api-access-l7cm5") pod "18bcb919-1645-4962-853d-f323fe3f76ed" (UID: "18bcb919-1645-4962-853d-f323fe3f76ed"). InnerVolumeSpecName "kube-api-access-l7cm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:32:10.467578 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:10.467552    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7cm5\" (UniqueName: \"kubernetes.io/projected/18bcb919-1645-4962-853d-f323fe3f76ed-kube-api-access-l7cm5\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:32:11.086398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.086358    2581 generic.go:356] "Generic (PLEG): container finished" podID="18bcb919-1645-4962-853d-f323fe3f76ed" containerID="1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94" exitCode=137
Sep 17 23:32:11.086398 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.086399    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:11.086646 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.086458    2581 scope.go:117] "RemoveContainer" containerID="1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94"
Sep 17 23:32:11.103784 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.103763    2581 scope.go:117] "RemoveContainer" containerID="1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94"
Sep 17 23:32:11.104096 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:32:11.104074    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94\": container with ID starting with 1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94 not found: ID does not exist" containerID="1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94"
Sep 17 23:32:11.104158 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.104105    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94"} err="failed to get container status \"1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94\": rpc error: code = NotFound desc = could not find container \"1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94\": container with ID starting with 1919a1e1812431b18d89941d4d42944267d42f4509fd648c955568c82c86cf94 not found: ID does not exist"
Sep 17 23:32:11.104472 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:32:11.104436    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-9d0d6f\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:11.658963 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:32:11.658924    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-9d0d6f\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" pod="opendatahub/test-curl-7638-9d0d6f"
Sep 17 23:32:11.660727 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:11.660704    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" path="/var/lib/kubelet/pods/18bcb919-1645-4962-853d-f323fe3f76ed/volumes"
Sep 17 23:32:16.950298 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:16.950260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:32:27.244714 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:27.244677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:32:47.644642 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:32:47.644607    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:33:11.842948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:11.842909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:33:22.178606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.178571    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-ae77d1"]
Sep 17 23:33:22.179168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.179149    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" containerName="test-curl-7638-9d0d6f"
Sep 17 23:33:22.179258 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.179170    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" containerName="test-curl-7638-9d0d6f"
Sep 17 23:33:22.179317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.179283    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bfc1285-69d8-4e0c-a661-c7af6e671e0a" containerName="istio-proxy"
Sep 17 23:33:22.179317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.179297    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bcb919-1645-4962-853d-f323fe3f76ed" containerName="test-curl-7638-9d0d6f"
Sep 17 23:33:22.179317 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.179309    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="be33632c-b09a-4e81-b967-9defe363eff0" containerName="istio-proxy"
Sep 17 23:33:22.182497 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.182477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:22.184788 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.184766    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8nhtg\""
Sep 17 23:33:22.188166 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.188145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-ae77d1"]
Sep 17 23:33:22.240547 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.240508    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6f8\" (UniqueName: \"kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8\") pod \"test-curl-7638-ae77d1\" (UID: \"bf117d2b-0149-450a-a218-e46c42ec211c\") " pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:22.341216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.341183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6f8\" (UniqueName: \"kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8\") pod \"test-curl-7638-ae77d1\" (UID: \"bf117d2b-0149-450a-a218-e46c42ec211c\") " pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:22.349277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.349250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6f8\" (UniqueName: \"kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8\") pod \"test-curl-7638-ae77d1\" (UID: \"bf117d2b-0149-450a-a218-e46c42ec211c\") " pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:22.492480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.492403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:22.761549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:22.761463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-ae77d1"]
Sep 17 23:33:22.764868 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:33:22.764839    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf117d2b_0149_450a_a218_e46c42ec211c.slice/crio-a5cc186db710d7645b5476426b65b0e0212d6112a98f0fb7c97f8b343e2d4c7a WatchSource:0}: Error finding container a5cc186db710d7645b5476426b65b0e0212d6112a98f0fb7c97f8b343e2d4c7a: Status 404 returned error can't find the container with id a5cc186db710d7645b5476426b65b0e0212d6112a98f0fb7c97f8b343e2d4c7a
Sep 17 23:33:23.446260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:23.446225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-ae77d1" event={"ID":"bf117d2b-0149-450a-a218-e46c42ec211c","Type":"ContainerStarted","Data":"9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd"}
Sep 17 23:33:23.446260 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:23.446266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-ae77d1" event={"ID":"bf117d2b-0149-450a-a218-e46c42ec211c","Type":"ContainerStarted","Data":"a5cc186db710d7645b5476426b65b0e0212d6112a98f0fb7c97f8b343e2d4c7a"}
Sep 17 23:33:23.460681 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:23.460633    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-ae77d1" podStartSLOduration=1.460619474 podStartE2EDuration="1.460619474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:33:23.46038075 +0000 UTC m=+1642.338895996" watchObservedRunningTime="2026-09-17 23:33:23.460619474 +0000 UTC m=+1642.339134720"
Sep 17 23:33:24.047137 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.047100    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-ae77d1"]
Sep 17 23:33:24.053292 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.053263    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-ae77d1"]
Sep 17 23:33:24.167950 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.167915    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7638-8de3ca"]
Sep 17 23:33:24.168391 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.168376    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" containerName="test-curl-7638-ae77d1"
Sep 17 23:33:24.168441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.168393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" containerName="test-curl-7638-ae77d1"
Sep 17 23:33:24.168490 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.168473    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" containerName="test-curl-7638-ae77d1"
Sep 17 23:33:24.171661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.171646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:24.178014 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.177982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-8de3ca"]
Sep 17 23:33:24.256399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.256364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6849x\" (UniqueName: \"kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x\") pod \"test-curl-7638-8de3ca\" (UID: \"2ceaefb6-af4e-4932-89c2-05834c2bf97f\") " pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:24.357511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.357473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6849x\" (UniqueName: \"kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x\") pod \"test-curl-7638-8de3ca\" (UID: \"2ceaefb6-af4e-4932-89c2-05834c2bf97f\") " pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:24.366118 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.366093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6849x\" (UniqueName: \"kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x\") pod \"test-curl-7638-8de3ca\" (UID: \"2ceaefb6-af4e-4932-89c2-05834c2bf97f\") " pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:24.451194 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:24.451113    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-ae77d1" container="test-curl-7638-ae77d1"
Sep 17 23:33:24.481848 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.481822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:24.750358 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:24.750332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7638-8de3ca"]
Sep 17 23:33:24.752613 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:33:24.752585    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ceaefb6_af4e_4932_89c2_05834c2bf97f.slice/crio-071ff7d2513993bc93ef13f912c298d1f61b4fdc6fd71b94557ccdc374bad598 WatchSource:0}: Error finding container 071ff7d2513993bc93ef13f912c298d1f61b4fdc6fd71b94557ccdc374bad598: Status 404 returned error can't find the container with id 071ff7d2513993bc93ef13f912c298d1f61b4fdc6fd71b94557ccdc374bad598
Sep 17 23:33:25.457874 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:25.457831    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-8de3ca" event={"ID":"2ceaefb6-af4e-4932-89c2-05834c2bf97f","Type":"ContainerStarted","Data":"74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa"}
Sep 17 23:33:25.458329 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:25.457884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7638-8de3ca" event={"ID":"2ceaefb6-af4e-4932-89c2-05834c2bf97f","Type":"ContainerStarted","Data":"071ff7d2513993bc93ef13f912c298d1f61b4fdc6fd71b94557ccdc374bad598"}
Sep 17 23:33:25.458329 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:25.457936    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-ae77d1" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" containerName="test-curl-7638-ae77d1" containerID="cri-o://9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd" gracePeriod=2
Sep 17 23:33:25.472767 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:25.472719    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7638-8de3ca" podStartSLOduration=1.472703422 podStartE2EDuration="1.472703422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:33:25.471271099 +0000 UTC m=+1644.349786344" watchObservedRunningTime="2026-09-17 23:33:25.472703422 +0000 UTC m=+1644.351218668"
Sep 17 23:33:25.473039 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:25.473017    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-ae77d1\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:25.474719 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:25.474698    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-ae77d1\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:26.060090 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:26.060058    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7638-8de3ca"]
Sep 17 23:33:26.063531 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:26.063503    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7638-8de3ca"]
Sep 17 23:33:26.463396 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:26.463368    2581 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7638-8de3ca" container="test-curl-7638-8de3ca"
Sep 17 23:33:26.644942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:26.644906    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:33:27.468385 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:27.468351    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7638-8de3ca" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" containerName="test-curl-7638-8de3ca" containerID="cri-o://74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa" gracePeriod=2
Sep 17 23:33:27.470304 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:27.470274    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-8de3ca\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:27.604730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:27.604703    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:27.606667 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:27.606636    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7638-8de3ca\" is forbidden: User \"system:node:ip-10-0-133-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-133-33.ec2.internal' and this object" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:27.780674 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:27.780586    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6f8\" (UniqueName: \"kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8\") pod \"bf117d2b-0149-450a-a218-e46c42ec211c\" (UID: \"bf117d2b-0149-450a-a218-e46c42ec211c\") "
Sep 17 23:33:27.782656 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:27.782632    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8" (OuterVolumeSpecName: "kube-api-access-sg6f8") pod "bf117d2b-0149-450a-a218-e46c42ec211c" (UID: "bf117d2b-0149-450a-a218-e46c42ec211c"). InnerVolumeSpecName "kube-api-access-sg6f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:33:27.881207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:27.881169    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6f8\" (UniqueName: \"kubernetes.io/projected/bf117d2b-0149-450a-a218-e46c42ec211c-kube-api-access-sg6f8\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:33:28.474553 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:28.474522    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf117d2b-0149-450a-a218-e46c42ec211c" containerID="9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd" exitCode=137
Sep 17 23:33:28.474986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:28.474568    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-ae77d1"
Sep 17 23:33:28.474986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:28.474624    2581 scope.go:117] "RemoveContainer" containerID="9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd"
Sep 17 23:33:28.484624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:28.484602    2581 scope.go:117] "RemoveContainer" containerID="9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd"
Sep 17 23:33:28.484925 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:28.484906    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd\": container with ID starting with 9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd not found: ID does not exist" containerID="9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd"
Sep 17 23:33:28.485017 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:28.484933    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd"} err="failed to get container status \"9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd\": rpc error: code = NotFound desc = could not find container \"9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd\": container with ID starting with 9e48c864f4c03d0be37342c93db08805de846efb6e795be8d158bbb215dec0cd not found: ID does not exist"
Sep 17 23:33:29.627977 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:29.627953    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:29.661099 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:29.661071    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf117d2b-0149-450a-a218-e46c42ec211c" path="/var/lib/kubelet/pods/bf117d2b-0149-450a-a218-e46c42ec211c/volumes"
Sep 17 23:33:29.693703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:29.693674    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6849x\" (UniqueName: \"kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x\") pod \"2ceaefb6-af4e-4932-89c2-05834c2bf97f\" (UID: \"2ceaefb6-af4e-4932-89c2-05834c2bf97f\") "
Sep 17 23:33:29.695850 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:29.695824    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x" (OuterVolumeSpecName: "kube-api-access-6849x") pod "2ceaefb6-af4e-4932-89c2-05834c2bf97f" (UID: "2ceaefb6-af4e-4932-89c2-05834c2bf97f"). InnerVolumeSpecName "kube-api-access-6849x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:33:29.794503 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:29.794424    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6849x\" (UniqueName: \"kubernetes.io/projected/2ceaefb6-af4e-4932-89c2-05834c2bf97f-kube-api-access-6849x\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:33:30.488365 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:30.488332    2581 generic.go:356] "Generic (PLEG): container finished" podID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" containerID="74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa" exitCode=137
Sep 17 23:33:30.488549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:30.488372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7638-8de3ca"
Sep 17 23:33:30.488549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:30.488436    2581 scope.go:117] "RemoveContainer" containerID="74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa"
Sep 17 23:33:30.500277 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:30.500254    2581 scope.go:117] "RemoveContainer" containerID="74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa"
Sep 17 23:33:30.500583 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:33:30.500561    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa\": container with ID starting with 74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa not found: ID does not exist" containerID="74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa"
Sep 17 23:33:30.500655 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:30.500592    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa"} err="failed to get container status \"74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa\": rpc error: code = NotFound desc = could not find container \"74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa\": container with ID starting with 74f77e0a2a6b5b52b5503c846a3c3c465845c44d2847b2be6cc6f756d336b4fa not found: ID does not exist"
Sep 17 23:33:31.660807 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:31.660772    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" path="/var/lib/kubelet/pods/2ceaefb6-af4e-4932-89c2-05834c2bf97f/volumes"
Sep 17 23:33:37.048266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:37.048232    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:33:45.345565 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:33:45.345530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:04.289238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:04.289202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:21.247517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:21.247482    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:36.235831 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:36.235757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:41.955715 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.955679    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:34:41.956294 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.956278    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" containerName="test-curl-7638-8de3ca"
Sep 17 23:34:41.956345 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.956298    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" containerName="test-curl-7638-8de3ca"
Sep 17 23:34:41.956412 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.956401    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ceaefb6-af4e-4932-89c2-05834c2bf97f" containerName="test-curl-7638-8de3ca"
Sep 17 23:34:41.959967 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.959948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:41.962250 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.962231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 23:34:41.962377 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.962233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-93a496-openshift-default-dockercfg-q6mhd\""
Sep 17 23:34:41.969703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:41.969681    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:34:42.021318 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021318 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021487    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021697 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwv4h\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.021697 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.021606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.122955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.122919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.122955 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.122957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwv4h\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123247 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123623 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123694 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.123758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.124001 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.123980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.124162 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.124107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.125549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.125529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.125760 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.125743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.131575 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.131546    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.131661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.131584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwv4h\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h\") pod \"e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") " pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.272730 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.272643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:42.550120 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.550086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:34:42.552520 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:34:42.552488    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48c5f740_80d8_49a4_9aae_78ad322605d7.slice/crio-3cb1ec70cd82cb7de65ef5f34523f69923f4c3027298c5055101ac168da6b1c4 WatchSource:0}: Error finding container 3cb1ec70cd82cb7de65ef5f34523f69923f4c3027298c5055101ac168da6b1c4: Status 404 returned error can't find the container with id 3cb1ec70cd82cb7de65ef5f34523f69923f4c3027298c5055101ac168da6b1c4
Sep 17 23:34:42.554589 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.554556    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:34:42.554679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.554614    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:34:42.554679 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.554643    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:34:42.840561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.840470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerStarted","Data":"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"}
Sep 17 23:34:42.840561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.840530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerStarted","Data":"3cb1ec70cd82cb7de65ef5f34523f69923f4c3027298c5055101ac168da6b1c4"}
Sep 17 23:34:42.866085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:42.866018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podStartSLOduration=1.866002927 podStartE2EDuration="1.866002927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:34:42.86483106 +0000 UTC m=+1721.743346307" watchObservedRunningTime="2026-09-17 23:34:42.866002927 +0000 UTC m=+1721.744518172"
Sep 17 23:34:43.272972 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:43.272940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:43.277561 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:43.277536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:43.845376 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:43.845343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:43.846325 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:43.846304    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:34:45.555214 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:45.555176    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:46.360865 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.360832    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:34:46.365254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.365231    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.368146 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.367705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-93a496-serving-cert\""
Sep 17 23:34:46.376568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.376522    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:34:46.464168 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.464127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcrrg\" (UniqueName: \"kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.464355 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.464202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.464355 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.464282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.464355 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.464307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.565238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.565211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.565238 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.565237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.565736 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.565293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcrrg\" (UniqueName: \"kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.565736 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.565319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.565984 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.565956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.567882 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.567858    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.567980 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.567911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.573012 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.572988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcrrg\" (UniqueName: \"kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg\") pod \"maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.679254 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.679227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:46.953432 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.953400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:34:46.955146 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:34:46.955115    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode49e86ae_47ba_4e16_8bfc_8ed707725415.slice/crio-f9cbe9b40040c07e668c8ef5cf7d86e632b6e4d74ac77c1d95c6ef07c83e09f3 WatchSource:0}: Error finding container f9cbe9b40040c07e668c8ef5cf7d86e632b6e4d74ac77c1d95c6ef07c83e09f3: Status 404 returned error can't find the container with id f9cbe9b40040c07e668c8ef5cf7d86e632b6e4d74ac77c1d95c6ef07c83e09f3
Sep 17 23:34:46.956688 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:46.956670    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:34:47.866883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:47.866777    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" event={"ID":"e49e86ae-47ba-4e16-8bfc-8ed707725415","Type":"ContainerStarted","Data":"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"}
Sep 17 23:34:47.866883 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:47.866830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" event={"ID":"e49e86ae-47ba-4e16-8bfc-8ed707725415","Type":"ContainerStarted","Data":"f9cbe9b40040c07e668c8ef5cf7d86e632b6e4d74ac77c1d95c6ef07c83e09f3"}
Sep 17 23:34:47.867416 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:47.866943    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:47.883231 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:47.883183    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" podStartSLOduration=1.39934842 podStartE2EDuration="1.883168496s" totalImagesPullingTime="483.820076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:34:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:34:47.881564362 +0000 UTC m=+1726.760079617" watchObservedRunningTime="2026-09-17 23:34:47.883168496 +0000 UTC m=+1726.761683741"
Sep 17 23:34:53.876735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:53.876706    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:34:55.748634 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:55.748600    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:34:59.887261 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:59.887219    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 23:34:59.887664 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:34:59.887288    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 23:35:01.945111 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.945078    2581 generic.go:356] "Generic (PLEG): container finished" podID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerID="fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90" exitCode=0
Sep 17 23:35:01.945650 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.945159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerDied","Data":"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"}
Sep 17 23:35:01.945720 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.945673    2581 scope.go:117] "RemoveContainer" containerID="fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"
Sep 17 23:35:01.946762 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.946736    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:35:01.946872 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.946814    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:35:01.946872 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:01.946863    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 23:35:02.952293 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:02.952258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerStarted","Data":"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"}
Sep 17 23:35:03.272930 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:03.272843    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:35:03.273134 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:03.273111    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 17 23:35:03.273194 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:03.273174    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 17 23:35:04.273446 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:04.273409    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 17 23:35:04.273829 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:04.273467    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 17 23:35:05.273358 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:05.273323    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 17 23:35:05.273572 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:05.273396    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 17 23:35:06.273249 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:06.273216    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 17 23:35:06.273424 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:06.273266    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 17 23:35:07.273312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:07.273273    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 17 23:35:07.273768 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:07.273340    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 17 23:35:08.276514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:08.276483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:35:08.276943 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:08.276826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:35:08.277441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:08.277423    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:35:15.621717 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.621677    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:35:15.625528 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.625513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.627612 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.627591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-86dda1-serving-cert\""
Sep 17 23:35:15.634575 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.634553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:35:15.634959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.634944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.635070 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.634988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qqjz\" (UniqueName: \"kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.635156 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.635132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.635240 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.635225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.736359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.736328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.736552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.736372    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qqjz\" (UniqueName: \"kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.736552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.736416    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.736552 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.736456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.736552 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:35:15.736488    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-serving-cert: secret "maas-api-e2e-ipp-b-86dda1-serving-cert" not found
Sep 17 23:35:15.736771 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:35:15.736568    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls podName:778a3e77-5daa-47f0-8c37-b5ba99c38563 nodeName:}" failed. No retries permitted until 2026-09-17 23:35:16.236547263 +0000 UTC m=+1755.115062501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls") pod "maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" (UID: "778a3e77-5daa-47f0-8c37-b5ba99c38563") : secret "maas-api-e2e-ipp-b-86dda1-serving-cert" not found
Sep 17 23:35:15.737084 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.737037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.738855 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.738834    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:15.746127 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:15.746107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qqjz\" (UniqueName: \"kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:16.241473 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:16.241441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:16.243912 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:16.243882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") pod \"maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:16.537583 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:16.537504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:16.812614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:16.812591    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:35:16.814821 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:35:16.814799    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778a3e77_5daa_47f0_8c37_b5ba99c38563.slice/crio-fdae4fd859e127f4822f7827070784ba3035e40faf5555ab169dbd3cc5d10c01 WatchSource:0}: Error finding container fdae4fd859e127f4822f7827070784ba3035e40faf5555ab169dbd3cc5d10c01: Status 404 returned error can't find the container with id fdae4fd859e127f4822f7827070784ba3035e40faf5555ab169dbd3cc5d10c01
Sep 17 23:35:17.025008 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:17.024972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" event={"ID":"778a3e77-5daa-47f0-8c37-b5ba99c38563","Type":"ContainerStarted","Data":"fdae4fd859e127f4822f7827070784ba3035e40faf5555ab169dbd3cc5d10c01"}
Sep 17 23:35:18.032870 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:18.032834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" event={"ID":"778a3e77-5daa-47f0-8c37-b5ba99c38563","Type":"ContainerStarted","Data":"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"}
Sep 17 23:35:18.033341 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:18.032950    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:18.054225 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:18.054181    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" podStartSLOduration=2.641126556 podStartE2EDuration="3.054164892s" totalImagesPullingTime="413.038336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:35:18.052672095 +0000 UTC m=+1756.931187340" watchObservedRunningTime="2026-09-17 23:35:18.054164892 +0000 UTC m=+1756.932680137"
Sep 17 23:35:20.345765 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:20.345731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:35:24.043722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:24.043690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:35:58.545465 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:35:58.545393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:36:01.724207 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:01.724178    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:36:01.728482 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:01.728459    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:36:13.236502 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:13.236468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:36:26.918962 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.918929    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:26.923124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.923095    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:26.925726 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.925700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-145e15-serving-cert\""
Sep 17 23:36:26.936643 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.936616    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:26.979715 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.979690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:26.979849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.979727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:26.979849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.979832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:26.979931 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:26.979866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs59t\" (UniqueName: \"kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.081124 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.081083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.081326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.081177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.081326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.081201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs59t\" (UniqueName: \"kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.081326 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.081292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.081927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.081902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.083635 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.083617    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.083704 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.083669    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.089385 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.089355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs59t\" (UniqueName: \"kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t\") pod \"maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.235367 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.235291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:27.511235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:27.511208    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:27.513261 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:36:27.513221    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3495f846_21f8_4f75_9989_492ec6a43c45.slice/crio-cbd2cfb7528e75bb6e9086e3758f77f872b2a60f1c4d0c161e3569438ad65460 WatchSource:0}: Error finding container cbd2cfb7528e75bb6e9086e3758f77f872b2a60f1c4d0c161e3569438ad65460: Status 404 returned error can't find the container with id cbd2cfb7528e75bb6e9086e3758f77f872b2a60f1c4d0c161e3569438ad65460
Sep 17 23:36:28.381975 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:28.381939    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" event={"ID":"3495f846-21f8-4f75-9989-492ec6a43c45","Type":"ContainerStarted","Data":"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"}
Sep 17 23:36:28.382399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:28.382005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" event={"ID":"3495f846-21f8-4f75-9989-492ec6a43c45","Type":"ContainerStarted","Data":"cbd2cfb7528e75bb6e9086e3758f77f872b2a60f1c4d0c161e3569438ad65460"}
Sep 17 23:36:28.382399 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:28.382035    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:28.400284 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:28.400236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" podStartSLOduration=2.020136607 podStartE2EDuration="2.400221561s" totalImagesPullingTime="380.084954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:36:28.398217647 +0000 UTC m=+1827.276732895" watchObservedRunningTime="2026-09-17 23:36:28.400221561 +0000 UTC m=+1827.278736854"
Sep 17 23:36:32.238105 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:32.238063    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:36:34.392107 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:34.392075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:55.677494 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.677459    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:55.678388 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.677690    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" podUID="3495f846-21f8-4f75-9989-492ec6a43c45" containerName="maas-api" containerID="cri-o://54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7" gracePeriod=30
Sep 17 23:36:55.929669 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.929608    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:55.946383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.946350    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rs59t\" (UniqueName: \"kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t\") pod \"3495f846-21f8-4f75-9989-492ec6a43c45\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") "
Sep 17 23:36:55.946523 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.946418    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs\") pod \"3495f846-21f8-4f75-9989-492ec6a43c45\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") "
Sep 17 23:36:55.946523 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.946461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls\") pod \"3495f846-21f8-4f75-9989-492ec6a43c45\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") "
Sep 17 23:36:55.946614 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.946527    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca\") pod \"3495f846-21f8-4f75-9989-492ec6a43c45\" (UID: \"3495f846-21f8-4f75-9989-492ec6a43c45\") "
Sep 17 23:36:55.946888 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.946864    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3495f846-21f8-4f75-9989-492ec6a43c45" (UID: "3495f846-21f8-4f75-9989-492ec6a43c45"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:36:55.948816 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.948675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t" (OuterVolumeSpecName: "kube-api-access-rs59t") pod "3495f846-21f8-4f75-9989-492ec6a43c45" (UID: "3495f846-21f8-4f75-9989-492ec6a43c45"). InnerVolumeSpecName "kube-api-access-rs59t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:36:55.948816 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.948728    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3495f846-21f8-4f75-9989-492ec6a43c45" (UID: "3495f846-21f8-4f75-9989-492ec6a43c45"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:36:55.948983 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:55.948836    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3495f846-21f8-4f75-9989-492ec6a43c45" (UID: "3495f846-21f8-4f75-9989-492ec6a43c45"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:36:56.048229 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.048194    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:36:56.048229 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.048222    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3495f846-21f8-4f75-9989-492ec6a43c45-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:36:56.048229 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.048232    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3495f846-21f8-4f75-9989-492ec6a43c45-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:36:56.048461 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.048241    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rs59t\" (UniqueName: \"kubernetes.io/projected/3495f846-21f8-4f75-9989-492ec6a43c45-kube-api-access-rs59t\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:36:56.531861 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.531824    2581 generic.go:356] "Generic (PLEG): container finished" podID="3495f846-21f8-4f75-9989-492ec6a43c45" containerID="54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7" exitCode=0
Sep 17 23:36:56.532029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.531872    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"
Sep 17 23:36:56.532029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.531907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" event={"ID":"3495f846-21f8-4f75-9989-492ec6a43c45","Type":"ContainerDied","Data":"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"}
Sep 17 23:36:56.532029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.531964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8" event={"ID":"3495f846-21f8-4f75-9989-492ec6a43c45","Type":"ContainerDied","Data":"cbd2cfb7528e75bb6e9086e3758f77f872b2a60f1c4d0c161e3569438ad65460"}
Sep 17 23:36:56.532029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.531989    2581 scope.go:117] "RemoveContainer" containerID="54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"
Sep 17 23:36:56.542252 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.542233    2581 scope.go:117] "RemoveContainer" containerID="54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"
Sep 17 23:36:56.542507 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:36:56.542484    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7\": container with ID starting with 54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7 not found: ID does not exist" containerID="54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"
Sep 17 23:36:56.542590 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.542516    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7"} err="failed to get container status \"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7\": rpc error: code = NotFound desc = could not find container \"54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7\": container with ID starting with 54f5ebd4588959a74f2421edcb7a5e2f398784deff01433ff6911fd029e42ee7 not found: ID does not exist"
Sep 17 23:36:56.569992 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.569967    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:56.576380 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:56.576358    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-145e15-557b4f8dd9-snpl8"]
Sep 17 23:36:57.661149 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:36:57.661119    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3495f846-21f8-4f75-9989-492ec6a43c45" path="/var/lib/kubelet/pods/3495f846-21f8-4f75-9989-492ec6a43c45/volumes"
Sep 17 23:37:00.238444 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:00.238407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:37:18.947387 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:18.947350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:37:21.347902 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.347868    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:37:21.348310 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.348100    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" podUID="e49e86ae-47ba-4e16-8bfc-8ed707725415" containerName="maas-api" containerID="cri-o://5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e" gracePeriod=30
Sep 17 23:37:21.598919 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.598866    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:37:21.659005 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.658976    2581 generic.go:356] "Generic (PLEG): container finished" podID="e49e86ae-47ba-4e16-8bfc-8ed707725415" containerID="5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e" exitCode=0
Sep 17 23:37:21.659165 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.659115    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"
Sep 17 23:37:21.663059 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.663007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" event={"ID":"e49e86ae-47ba-4e16-8bfc-8ed707725415","Type":"ContainerDied","Data":"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"}
Sep 17 23:37:21.663178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.663082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c" event={"ID":"e49e86ae-47ba-4e16-8bfc-8ed707725415","Type":"ContainerDied","Data":"f9cbe9b40040c07e668c8ef5cf7d86e632b6e4d74ac77c1d95c6ef07c83e09f3"}
Sep 17 23:37:21.663178 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.663097    2581 scope.go:117] "RemoveContainer" containerID="5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"
Sep 17 23:37:21.671769 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.671751    2581 scope.go:117] "RemoveContainer" containerID="5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"
Sep 17 23:37:21.672027 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:37:21.672009    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e\": container with ID starting with 5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e not found: ID does not exist" containerID="5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"
Sep 17 23:37:21.672099 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.672036    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e"} err="failed to get container status \"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e\": rpc error: code = NotFound desc = could not find container \"5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e\": container with ID starting with 5c1679affb04d5a241f316f818255438623071fe642cb22123c6e45a0a3d156e not found: ID does not exist"
Sep 17 23:37:21.677343 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca\") pod \"e49e86ae-47ba-4e16-8bfc-8ed707725415\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") "
Sep 17 23:37:21.677439 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcrrg\" (UniqueName: \"kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg\") pod \"e49e86ae-47ba-4e16-8bfc-8ed707725415\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") "
Sep 17 23:37:21.677554 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677539    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls\") pod \"e49e86ae-47ba-4e16-8bfc-8ed707725415\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") "
Sep 17 23:37:21.677621 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677574    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs\") pod \"e49e86ae-47ba-4e16-8bfc-8ed707725415\" (UID: \"e49e86ae-47ba-4e16-8bfc-8ed707725415\") "
Sep 17 23:37:21.677722 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e49e86ae-47ba-4e16-8bfc-8ed707725415" (UID: "e49e86ae-47ba-4e16-8bfc-8ed707725415"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:37:21.677927 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.677911    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e49e86ae-47ba-4e16-8bfc-8ed707725415-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:37:21.679451 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.679420    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg" (OuterVolumeSpecName: "kube-api-access-xcrrg") pod "e49e86ae-47ba-4e16-8bfc-8ed707725415" (UID: "e49e86ae-47ba-4e16-8bfc-8ed707725415"). InnerVolumeSpecName "kube-api-access-xcrrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:37:21.679549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.679497    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e49e86ae-47ba-4e16-8bfc-8ed707725415" (UID: "e49e86ae-47ba-4e16-8bfc-8ed707725415"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:37:21.679549 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.679539    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e49e86ae-47ba-4e16-8bfc-8ed707725415" (UID: "e49e86ae-47ba-4e16-8bfc-8ed707725415"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:37:21.778758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.778727    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcrrg\" (UniqueName: \"kubernetes.io/projected/e49e86ae-47ba-4e16-8bfc-8ed707725415-kube-api-access-xcrrg\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:37:21.778758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.778753    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:37:21.778758 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.778762    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e49e86ae-47ba-4e16-8bfc-8ed707725415-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:37:21.981235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.981207    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:37:21.985430 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:21.985400    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-93a496-7b795f4d55-zp79c"]
Sep 17 23:37:23.661251 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:23.661217    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e49e86ae-47ba-4e16-8bfc-8ed707725415" path="/var/lib/kubelet/pods/e49e86ae-47ba-4e16-8bfc-8ed707725415/volumes"
Sep 17 23:37:31.749536 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:37:31.749503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:38:10.419480 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:10.419443    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:38:10.420031 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:10.419706    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy" containerID="cri-o://fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282" gracePeriod=30
Sep 17 23:38:15.677824 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.677799    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:38:15.769948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.769863    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.769948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.769911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.769948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.769943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.769978    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770013    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770089    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770131    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770177    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770266 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770222    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwv4h\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h\") pod \"48c5f740-80d8-49a4-9aae-78ad322605d7\" (UID: \"48c5f740-80d8-49a4-9aae-78ad322605d7\") "
Sep 17 23:38:15.770569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770316    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:15.770569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770363    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:15.770569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770393    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:15.770569 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770404    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:15.770803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770626    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:15.770803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770653    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.770803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770677    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-data\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.770803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770692    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-workload-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.770803 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.770704    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48c5f740-80d8-49a4-9aae-78ad322605d7-istiod-ca-cert\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.772236 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.772210    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 23:38:15.772369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.772353    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h" (OuterVolumeSpecName: "kube-api-access-gwv4h") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "kube-api-access-gwv4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:15.772509 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.772495    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:15.772570 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.772558    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48c5f740-80d8-49a4-9aae-78ad322605d7" (UID: "48c5f740-80d8-49a4-9aae-78ad322605d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 23:38:15.871976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.871925    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-credential-socket\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.871976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.871970    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-envoy\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.871976 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.871981    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-podinfo\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.872239 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.871990    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwv4h\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-kube-api-access-gwv4h\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.872239 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.871999    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48c5f740-80d8-49a4-9aae-78ad322605d7-istio-token\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:15.927253 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.927219    2581 generic.go:356] "Generic (PLEG): container finished" podID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerID="fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282" exitCode=0
Sep 17 23:38:15.927441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.927271    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"
Sep 17 23:38:15.927441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.927305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerDied","Data":"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"}
Sep 17 23:38:15.927441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.927359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp" event={"ID":"48c5f740-80d8-49a4-9aae-78ad322605d7","Type":"ContainerDied","Data":"3cb1ec70cd82cb7de65ef5f34523f69923f4c3027298c5055101ac168da6b1c4"}
Sep 17 23:38:15.927441 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.927381    2581 scope.go:117] "RemoveContainer" containerID="fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"
Sep 17 23:38:15.936719 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.936700    2581 scope.go:117] "RemoveContainer" containerID="fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"
Sep 17 23:38:15.944504 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.944483    2581 scope.go:117] "RemoveContainer" containerID="fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"
Sep 17 23:38:15.944773 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:38:15.944753    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282\": container with ID starting with fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282 not found: ID does not exist" containerID="fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"
Sep 17 23:38:15.944835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.944780    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282"} err="failed to get container status \"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282\": rpc error: code = NotFound desc = could not find container \"fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282\": container with ID starting with fb2c39afa8a552536dbbbcb03a10c812ab373e0f1f84d0c6f0656bff77fa0282 not found: ID does not exist"
Sep 17 23:38:15.944835 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.944797    2581 scope.go:117] "RemoveContainer" containerID="fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"
Sep 17 23:38:15.945068 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:38:15.945023    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90\": container with ID starting with fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90 not found: ID does not exist" containerID="fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"
Sep 17 23:38:15.945159 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.945121    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90"} err="failed to get container status \"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90\": rpc error: code = NotFound desc = could not find container \"fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90\": container with ID starting with fdaee5a7e93ebb5c9ff47f1bc2bd73d353699e17652f61b38a965c27b992cb90 not found: ID does not exist"
Sep 17 23:38:15.948745 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.948722    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:38:15.952689 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:15.952669    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-93a496-openshift-default-5bd968988b-6nwqp"]
Sep 17 23:38:17.661291 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:17.661248    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" path="/var/lib/kubelet/pods/48c5f740-80d8-49a4-9aae-78ad322605d7/volumes"
Sep 17 23:38:21.229985 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.229950    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:38:21.230500 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.230171    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" podUID="778a3e77-5daa-47f0-8c37-b5ba99c38563" containerName="maas-api" containerID="cri-o://e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf" gracePeriod=30
Sep 17 23:38:21.476233 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.476209    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:38:21.521595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.521505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") pod \"778a3e77-5daa-47f0-8c37-b5ba99c38563\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") "
Sep 17 23:38:21.521749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.521628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qqjz\" (UniqueName: \"kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz\") pod \"778a3e77-5daa-47f0-8c37-b5ba99c38563\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") "
Sep 17 23:38:21.521749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.521683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca\") pod \"778a3e77-5daa-47f0-8c37-b5ba99c38563\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") "
Sep 17 23:38:21.521749 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.521715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs\") pod \"778a3e77-5daa-47f0-8c37-b5ba99c38563\" (UID: \"778a3e77-5daa-47f0-8c37-b5ba99c38563\") "
Sep 17 23:38:21.522125 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.522093    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "778a3e77-5daa-47f0-8c37-b5ba99c38563" (UID: "778a3e77-5daa-47f0-8c37-b5ba99c38563"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:21.523703 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.523669    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz" (OuterVolumeSpecName: "kube-api-access-2qqjz") pod "778a3e77-5daa-47f0-8c37-b5ba99c38563" (UID: "778a3e77-5daa-47f0-8c37-b5ba99c38563"). InnerVolumeSpecName "kube-api-access-2qqjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:21.523796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.523715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "778a3e77-5daa-47f0-8c37-b5ba99c38563" (UID: "778a3e77-5daa-47f0-8c37-b5ba99c38563"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:21.523796 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.523725    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "778a3e77-5daa-47f0-8c37-b5ba99c38563" (UID: "778a3e77-5daa-47f0-8c37-b5ba99c38563"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:21.623255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.623221    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:21.623255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.623249    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/778a3e77-5daa-47f0-8c37-b5ba99c38563-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:21.623255 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.623259    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qqjz\" (UniqueName: \"kubernetes.io/projected/778a3e77-5daa-47f0-8c37-b5ba99c38563-kube-api-access-2qqjz\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:21.623485 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.623267    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/778a3e77-5daa-47f0-8c37-b5ba99c38563-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:21.964869 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.964833    2581 generic.go:356] "Generic (PLEG): container finished" podID="778a3e77-5daa-47f0-8c37-b5ba99c38563" containerID="e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf" exitCode=0
Sep 17 23:38:21.965093 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.964879    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"
Sep 17 23:38:21.965093 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.964923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" event={"ID":"778a3e77-5daa-47f0-8c37-b5ba99c38563","Type":"ContainerDied","Data":"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"}
Sep 17 23:38:21.965093 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.964982    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb" event={"ID":"778a3e77-5daa-47f0-8c37-b5ba99c38563","Type":"ContainerDied","Data":"fdae4fd859e127f4822f7827070784ba3035e40faf5555ab169dbd3cc5d10c01"}
Sep 17 23:38:21.965093 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.965010    2581 scope.go:117] "RemoveContainer" containerID="e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"
Sep 17 23:38:21.973849 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.973832    2581 scope.go:117] "RemoveContainer" containerID="e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"
Sep 17 23:38:21.974139 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:38:21.974120    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf\": container with ID starting with e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf not found: ID does not exist" containerID="e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"
Sep 17 23:38:21.974202 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.974147    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf"} err="failed to get container status \"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf\": rpc error: code = NotFound desc = could not find container \"e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf\": container with ID starting with e21dc4f09bace78a4f0c49ab88b167bec2e7ac0fa15775748bdb6071b47971cf not found: ID does not exist"
Sep 17 23:38:21.982615 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.982591    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:38:21.986947 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:21.986927    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-86dda1-7d67c569bd-lbffb"]
Sep 17 23:38:23.661092 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:23.661040    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778a3e77-5daa-47f0-8c37-b5ba99c38563" path="/var/lib/kubelet/pods/778a3e77-5daa-47f0-8c37-b5ba99c38563/volumes"
Sep 17 23:38:23.949031 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:23.948949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:38:39.018436 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.018404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:38:39.018900 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.018670    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" podUID="f3c7fd02-d166-468c-b6a6-8050a580ad77" containerName="maas-api" containerID="cri-o://22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8" gracePeriod=30
Sep 17 23:38:39.270322 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.270256    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:38:39.380029 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.380002    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") pod \"f3c7fd02-d166-468c-b6a6-8050a580ad77\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") "
Sep 17 23:38:39.380237 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.380068    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs\") pod \"f3c7fd02-d166-468c-b6a6-8050a580ad77\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") "
Sep 17 23:38:39.380237 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.380159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca\") pod \"f3c7fd02-d166-468c-b6a6-8050a580ad77\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") "
Sep 17 23:38:39.380237 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.380199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgcjp\" (UniqueName: \"kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp\") pod \"f3c7fd02-d166-468c-b6a6-8050a580ad77\" (UID: \"f3c7fd02-d166-468c-b6a6-8050a580ad77\") "
Sep 17 23:38:39.380652 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.380591    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3c7fd02-d166-468c-b6a6-8050a580ad77" (UID: "f3c7fd02-d166-468c-b6a6-8050a580ad77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:39.382408 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.382365    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp" (OuterVolumeSpecName: "kube-api-access-wgcjp") pod "f3c7fd02-d166-468c-b6a6-8050a580ad77" (UID: "f3c7fd02-d166-468c-b6a6-8050a580ad77"). InnerVolumeSpecName "kube-api-access-wgcjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:39.382696 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.382661    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3c7fd02-d166-468c-b6a6-8050a580ad77" (UID: "f3c7fd02-d166-468c-b6a6-8050a580ad77"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:39.382810 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.382699    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3c7fd02-d166-468c-b6a6-8050a580ad77" (UID: "f3c7fd02-d166-468c-b6a6-8050a580ad77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:39.481492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.481449    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:39.481492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.481485    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3c7fd02-d166-468c-b6a6-8050a580ad77-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:39.481492 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.481497    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7fd02-d166-468c-b6a6-8050a580ad77-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:39.481808 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:39.481507    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgcjp\" (UniqueName: \"kubernetes.io/projected/f3c7fd02-d166-468c-b6a6-8050a580ad77-kube-api-access-wgcjp\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:40.056970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.056873    2581 generic.go:356] "Generic (PLEG): container finished" podID="f3c7fd02-d166-468c-b6a6-8050a580ad77" containerID="22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8" exitCode=0
Sep 17 23:38:40.056970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.056925    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"
Sep 17 23:38:40.056970 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.056961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" event={"ID":"f3c7fd02-d166-468c-b6a6-8050a580ad77","Type":"ContainerDied","Data":"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"}
Sep 17 23:38:40.057563 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.057016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967" event={"ID":"f3c7fd02-d166-468c-b6a6-8050a580ad77","Type":"ContainerDied","Data":"260698653eab21d5eceaabb862f7fd6be3d1b98556a92fe831abc6eb4c4969f6"}
Sep 17 23:38:40.057563 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.057038    2581 scope.go:117] "RemoveContainer" containerID="22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"
Sep 17 23:38:40.065938 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.065916    2581 scope.go:117] "RemoveContainer" containerID="22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"
Sep 17 23:38:40.066236 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:38:40.066219    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8\": container with ID starting with 22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8 not found: ID does not exist" containerID="22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"
Sep 17 23:38:40.066302 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.066244    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8"} err="failed to get container status \"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8\": rpc error: code = NotFound desc = could not find container \"22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8\": container with ID starting with 22a2e50bc02516402f7f19cb17c81768a671854308a9af330a46f0bee6d8d6b8 not found: ID does not exist"
Sep 17 23:38:40.073834 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.073810    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:38:40.077529 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:40.077508    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-e5aae7-69d99c4f9b-7c967"]
Sep 17 23:38:41.661546 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:41.661516    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c7fd02-d166-468c-b6a6-8050a580ad77" path="/var/lib/kubelet/pods/f3c7fd02-d166-468c-b6a6-8050a580ad77/volumes"
Sep 17 23:38:41.946216 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:41.946137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:38:56.879778 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:56.879694    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:38:56.880165 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:56.879980    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" podUID="47079b23-8722-489a-8e41-f8932df2a15b" containerName="maas-api" containerID="cri-o://1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee" gracePeriod=30
Sep 17 23:38:56.916539 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:56.916505    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" podUID="47079b23-8722-489a-8e41-f8932df2a15b" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.75:8443/health\": dial tcp 10.132.0.75:8443: connect: connection refused"
Sep 17 23:38:57.124121 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.124095    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:38:57.147267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.147200    2581 generic.go:356] "Generic (PLEG): container finished" podID="47079b23-8722-489a-8e41-f8932df2a15b" containerID="1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee" exitCode=0
Sep 17 23:38:57.147267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.147237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" event={"ID":"47079b23-8722-489a-8e41-f8932df2a15b","Type":"ContainerDied","Data":"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"}
Sep 17 23:38:57.147267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.147245    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"
Sep 17 23:38:57.147533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.147279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q" event={"ID":"47079b23-8722-489a-8e41-f8932df2a15b","Type":"ContainerDied","Data":"9bb2af797529451c38b2d395236b5dd701eaad17f900fe110866f0f22f0e775f"}
Sep 17 23:38:57.147533 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.147336    2581 scope.go:117] "RemoveContainer" containerID="1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"
Sep 17 23:38:57.163723 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.163690    2581 scope.go:117] "RemoveContainer" containerID="1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"
Sep 17 23:38:57.163992 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:38:57.163968    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee\": container with ID starting with 1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee not found: ID does not exist" containerID="1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"
Sep 17 23:38:57.164081 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.164005    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee"} err="failed to get container status \"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee\": rpc error: code = NotFound desc = could not find container \"1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee\": container with ID starting with 1c20ba8bc5fefd57e1a71f077e115527c8dd0a16fd63e3a39e31bb7698cd3aee not found: ID does not exist"
Sep 17 23:38:57.238038 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.238007    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs\") pod \"47079b23-8722-489a-8e41-f8932df2a15b\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") "
Sep 17 23:38:57.238206 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.238122    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") pod \"47079b23-8722-489a-8e41-f8932df2a15b\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") "
Sep 17 23:38:57.238206 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.238157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca\") pod \"47079b23-8722-489a-8e41-f8932df2a15b\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") "
Sep 17 23:38:57.238337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.238236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf4g9\" (UniqueName: \"kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9\") pod \"47079b23-8722-489a-8e41-f8932df2a15b\" (UID: \"47079b23-8722-489a-8e41-f8932df2a15b\") "
Sep 17 23:38:57.238568 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.238544    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "47079b23-8722-489a-8e41-f8932df2a15b" (UID: "47079b23-8722-489a-8e41-f8932df2a15b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:38:57.240268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.240206    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "47079b23-8722-489a-8e41-f8932df2a15b" (UID: "47079b23-8722-489a-8e41-f8932df2a15b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:57.240268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.240232    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "47079b23-8722-489a-8e41-f8932df2a15b" (UID: "47079b23-8722-489a-8e41-f8932df2a15b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:38:57.240268 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.240250    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9" (OuterVolumeSpecName: "kube-api-access-rf4g9") pod "47079b23-8722-489a-8e41-f8932df2a15b" (UID: "47079b23-8722-489a-8e41-f8932df2a15b"). InnerVolumeSpecName "kube-api-access-rf4g9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:38:57.339781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.339751    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf4g9\" (UniqueName: \"kubernetes.io/projected/47079b23-8722-489a-8e41-f8932df2a15b-kube-api-access-rf4g9\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:57.339781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.339777    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:57.339781 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.339787    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/47079b23-8722-489a-8e41-f8932df2a15b-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:57.339994 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.339795    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/47079b23-8722-489a-8e41-f8932df2a15b-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:38:57.469580 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.469538    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:38:57.471198 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.471176    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6275e9-78545d4569-rh78q"]
Sep 17 23:38:57.660437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:57.660395    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47079b23-8722-489a-8e41-f8932df2a15b" path="/var/lib/kubelet/pods/47079b23-8722-489a-8e41-f8932df2a15b/volumes"
Sep 17 23:38:59.549096 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:38:59.549066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:39:07.843166 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:39:07.843130    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:40:28.041789 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:40:28.041710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:01.753795 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:01.753756    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:41:01.758755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:01.758731    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:41:06.539816 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:06.539781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:14.436751 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:14.436711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:21.635794 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:21.635749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:28.946798 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:28.946761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:43.343540 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:43.343503    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:41:51.143958 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:41:51.143918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:43:17.653228 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:43:17.653193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:43:24.442014 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:43:24.441939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:43:33.649454 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:43:33.649417    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:43:42.144487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:43:42.144450    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:07.650752 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:07.650716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:15.233993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:15.233956    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:24.239094 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.239054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:24.438393 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438361    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"]
Sep 17 23:44:24.438755 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438740    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438757    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438770    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778a3e77-5daa-47f0-8c37-b5ba99c38563" containerName="maas-api"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438775    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="778a3e77-5daa-47f0-8c37-b5ba99c38563" containerName="maas-api"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438781    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3495f846-21f8-4f75-9989-492ec6a43c45" containerName="maas-api"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438787    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3495f846-21f8-4f75-9989-492ec6a43c45" containerName="maas-api"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438795    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.438802 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438800    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438808    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c7fd02-d166-468c-b6a6-8050a580ad77" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438814    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c7fd02-d166-468c-b6a6-8050a580ad77" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438835    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47079b23-8722-489a-8e41-f8932df2a15b" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438841    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="47079b23-8722-489a-8e41-f8932df2a15b" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438850    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e49e86ae-47ba-4e16-8bfc-8ed707725415" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438855    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e49e86ae-47ba-4e16-8bfc-8ed707725415" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438917    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438924    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e49e86ae-47ba-4e16-8bfc-8ed707725415" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438932    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="47079b23-8722-489a-8e41-f8932df2a15b" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438938    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="48c5f740-80d8-49a4-9aae-78ad322605d7" containerName="istio-proxy"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438943    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c7fd02-d166-468c-b6a6-8050a580ad77" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438948    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3495f846-21f8-4f75-9989-492ec6a43c45" containerName="maas-api"
Sep 17 23:44:24.439016 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.438954    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="778a3e77-5daa-47f0-8c37-b5ba99c38563" containerName="maas-api"
Sep 17 23:44:24.442118 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.442094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.444394 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.444374    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xltjn\""
Sep 17 23:44:24.456712 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.456686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"]
Sep 17 23:44:24.539267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.539188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba76d67-236a-4dab-a498-5a776cf810f8-openshift-service-ca\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.539267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.539228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-metrics-certs\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.539267 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.539246    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-maas-api-tls\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.539486 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.539302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6zsd\" (UniqueName: \"kubernetes.io/projected/eba76d67-236a-4dab-a498-5a776cf810f8-kube-api-access-m6zsd\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.639765 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.639735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6zsd\" (UniqueName: \"kubernetes.io/projected/eba76d67-236a-4dab-a498-5a776cf810f8-kube-api-access-m6zsd\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.639921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.639831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba76d67-236a-4dab-a498-5a776cf810f8-openshift-service-ca\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.639921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.639859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-metrics-certs\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.639921 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.639880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-maas-api-tls\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.640648 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.640630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eba76d67-236a-4dab-a498-5a776cf810f8-openshift-service-ca\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.642367 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.642345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-maas-api-tls\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.642466 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.642390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba76d67-236a-4dab-a498-5a776cf810f8-metrics-certs\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.646711 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.646686    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6zsd\" (UniqueName: \"kubernetes.io/projected/eba76d67-236a-4dab-a498-5a776cf810f8-kube-api-access-m6zsd\") pod \"maas-api-d7bf8bdb7-tx7mk\" (UID: \"eba76d67-236a-4dab-a498-5a776cf810f8\") " pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:24.753764 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:24.753736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:25.023942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.023917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"]
Sep 17 23:44:25.025677 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:44:25.025652    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba76d67_236a_4dab_a498_5a776cf810f8.slice/crio-2cfebb9f4757adc81e1d41247701b9b547cd50891e3535bb3b7bae836885cf2d WatchSource:0}: Error finding container 2cfebb9f4757adc81e1d41247701b9b547cd50891e3535bb3b7bae836885cf2d: Status 404 returned error can't find the container with id 2cfebb9f4757adc81e1d41247701b9b547cd50891e3535bb3b7bae836885cf2d
Sep 17 23:44:25.027138 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.027118    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 23:44:25.705484 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.705404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk" event={"ID":"eba76d67-236a-4dab-a498-5a776cf810f8","Type":"ContainerStarted","Data":"7d5246234947d24ac491ce0610722d87fff7ac4576dbf26e8ebd0298f68028dd"}
Sep 17 23:44:25.705484 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.705450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk" event={"ID":"eba76d67-236a-4dab-a498-5a776cf810f8","Type":"ContainerStarted","Data":"2cfebb9f4757adc81e1d41247701b9b547cd50891e3535bb3b7bae836885cf2d"}
Sep 17 23:44:25.705911 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.705533    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:25.722353 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:25.722303    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk" podStartSLOduration=1.31698651 podStartE2EDuration="1.722283625s" totalImagesPullingTime="405.297115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:44:25.721451096 +0000 UTC m=+2304.599966367" watchObservedRunningTime="2026-09-17 23:44:25.722283625 +0000 UTC m=+2304.600798875"
Sep 17 23:44:31.716695 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:31.716667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d7bf8bdb7-tx7mk"
Sep 17 23:44:31.941157 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:31.941120    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:38.645100 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:38.645066    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:39.417301 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:39.417260    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:44:39.417530 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:39.417487    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" containerName="maas-api" containerID="cri-o://f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446" gracePeriod=30
Sep 17 23:44:40.353606 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.353567    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.40:8443/health\": dial tcp 10.132.0.40:8443: connect: connection refused"
Sep 17 23:44:40.668312 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.668288    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:44:40.766272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.766238    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs\") pod \"529b16a2-c90e-4a75-b633-96403d3e0935\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") "
Sep 17 23:44:40.766462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.766303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca\") pod \"529b16a2-c90e-4a75-b633-96403d3e0935\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") "
Sep 17 23:44:40.766462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.766336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4drw\" (UniqueName: \"kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw\") pod \"529b16a2-c90e-4a75-b633-96403d3e0935\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") "
Sep 17 23:44:40.766462 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.766366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls\") pod \"529b16a2-c90e-4a75-b633-96403d3e0935\" (UID: \"529b16a2-c90e-4a75-b633-96403d3e0935\") "
Sep 17 23:44:40.767639 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.766708    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "529b16a2-c90e-4a75-b633-96403d3e0935" (UID: "529b16a2-c90e-4a75-b633-96403d3e0935"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 23:44:40.776670 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.776636    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "529b16a2-c90e-4a75-b633-96403d3e0935" (UID: "529b16a2-c90e-4a75-b633-96403d3e0935"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:44:40.776670 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.776649    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw" (OuterVolumeSpecName: "kube-api-access-n4drw") pod "529b16a2-c90e-4a75-b633-96403d3e0935" (UID: "529b16a2-c90e-4a75-b633-96403d3e0935"). InnerVolumeSpecName "kube-api-access-n4drw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 23:44:40.777607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.777576    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "529b16a2-c90e-4a75-b633-96403d3e0935" (UID: "529b16a2-c90e-4a75-b633-96403d3e0935"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 23:44:40.783595 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.783567    2581 generic.go:356] "Generic (PLEG): container finished" podID="529b16a2-c90e-4a75-b633-96403d3e0935" containerID="f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446" exitCode=0
Sep 17 23:44:40.783694 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.783615    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"
Sep 17 23:44:40.783694 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.783652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" event={"ID":"529b16a2-c90e-4a75-b633-96403d3e0935","Type":"ContainerDied","Data":"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"}
Sep 17 23:44:40.783775 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.783726    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4" event={"ID":"529b16a2-c90e-4a75-b633-96403d3e0935","Type":"ContainerDied","Data":"65db077b6e2d040f2aa91eb7f32d09bb6597d17a24ebe573206da755861f78a4"}
Sep 17 23:44:40.783775 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.783747    2581 scope.go:117] "RemoveContainer" containerID="f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"
Sep 17 23:44:40.792776 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.792756    2581 scope.go:117] "RemoveContainer" containerID="f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"
Sep 17 23:44:40.793075 ip-10-0-133-33 kubenswrapper[2581]: E0917 23:44:40.793033    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446\": container with ID starting with f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446 not found: ID does not exist" containerID="f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"
Sep 17 23:44:40.793139 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.793083    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446"} err="failed to get container status \"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446\": rpc error: code = NotFound desc = could not find container \"f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446\": container with ID starting with f8c497b22e75c0c8df0ce10569a73e40bccd0bac7cf7f09157c4531ba278a446 not found: ID does not exist"
Sep 17 23:44:40.804834 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.804809    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:44:40.808085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.808037    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bb7f9d9f-995q4"]
Sep 17 23:44:40.867871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.867841    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-maas-api-tls\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:44:40.867871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.867866    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/529b16a2-c90e-4a75-b633-96403d3e0935-metrics-certs\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:44:40.867871 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.867875    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/529b16a2-c90e-4a75-b633-96403d3e0935-openshift-service-ca\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:44:40.868086 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:40.867884    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4drw\" (UniqueName: \"kubernetes.io/projected/529b16a2-c90e-4a75-b633-96403d3e0935-kube-api-access-n4drw\") on node \"ip-10-0-133-33.ec2.internal\" DevicePath \"\""
Sep 17 23:44:41.662369 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:41.662332    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" path="/var/lib/kubelet/pods/529b16a2-c90e-4a75-b633-96403d3e0935/volumes"
Sep 17 23:44:44.855586 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:44.855549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:51.537102 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:51.537070    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5j6tz"]
Sep 17 23:44:59.501118 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:59.501016    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zgdh8_86a199ad-6b4d-41ea-965a-e3c03443db9d/manager/0.log"
Sep 17 23:44:59.615403 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:44:59.615364    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qkcbv_41579c73-5001-400e-9bf9-f05acd5d2890/manager/0.log"
Sep 17 23:45:00.075616 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:00.075587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5976b594-9gf4w_97047ff6-810a-453c-bc81-14f8590e4af3/copy-manifests/0.log"
Sep 17 23:45:00.088742 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:00.088718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5976b594-9gf4w_97047ff6-810a-453c-bc81-14f8590e4af3/manager/0.log"
Sep 17 23:45:00.797887 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:00.797853    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d7bf8bdb7-tx7mk_eba76d67-236a-4dab-a498-5a776cf810f8/maas-api/0.log"
Sep 17 23:45:01.117357 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:01.117286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-f728k_a12f247e-7314-49a2-9227-9148c6eb8a87/postgres/0.log"
Sep 17 23:45:01.998259 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:01.998229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-s5zrk_389d3610-b781-4197-a77e-feefa7c9de91/manager/0.log"
Sep 17 23:45:02.443557 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:02.443535    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5j6tz_729bf33e-0012-401f-895d-d14318e1fb81/limitador/0.log"
Sep 17 23:45:02.560517 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:02.560493    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hb98l_230f8556-1fa7-45fc-88d5-02890c8861f8/manager/0.log"
Sep 17 23:45:03.264373 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:03.264344    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8d65647-rj8qn_3a5fb108-a3e1-4326-968f-d854ea5f38f0/kube-auth-proxy/0.log"
Sep 17 23:45:03.721310 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:03.721285    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454dbbfc8-27mq8_ffa416ac-87d1-4c73-b12e-f8b20f487184/router/0.log"
Sep 17 23:45:04.050765 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:04.050693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgh4_3c2b025a-e0e4-4600-8504-e73914d5bd92/main/0.log"
Sep 17 23:45:04.378098 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:04.378026    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-grtvh_0f7c07b7-3243-4637-9c53-3c75ef6af08e/main/0.log"
Sep 17 23:45:09.885337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.885305    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xj26g/must-gather-kt9cl"]
Sep 17 23:45:09.885735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.885688    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" containerName="maas-api"
Sep 17 23:45:09.885735 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.885699    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" containerName="maas-api"
Sep 17 23:45:09.885823 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.885770    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="529b16a2-c90e-4a75-b633-96403d3e0935" containerName="maas-api"
Sep 17 23:45:09.888778 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.888761    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:09.891559 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.891535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xj26g\"/\"openshift-service-ca.crt\""
Sep 17 23:45:09.892448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.892430    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xj26g\"/\"default-dockercfg-qmmhv\""
Sep 17 23:45:09.892539 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.892435    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xj26g\"/\"kube-root-ca.crt\""
Sep 17 23:45:09.897893 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:09.897870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xj26g/must-gather-kt9cl"]
Sep 17 23:45:10.009041 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.009011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvj4f\" (UniqueName: \"kubernetes.io/projected/8e80d928-2efa-483f-9329-e8116e27a731-kube-api-access-bvj4f\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.009172 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.009078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e80d928-2efa-483f-9329-e8116e27a731-must-gather-output\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.109824 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.109788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvj4f\" (UniqueName: \"kubernetes.io/projected/8e80d928-2efa-483f-9329-e8116e27a731-kube-api-access-bvj4f\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.109980 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.109832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e80d928-2efa-483f-9329-e8116e27a731-must-gather-output\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.110197 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.110177    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8e80d928-2efa-483f-9329-e8116e27a731-must-gather-output\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.118283 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.118262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvj4f\" (UniqueName: \"kubernetes.io/projected/8e80d928-2efa-483f-9329-e8116e27a731-kube-api-access-bvj4f\") pod \"must-gather-kt9cl\" (UID: \"8e80d928-2efa-483f-9329-e8116e27a731\") " pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.198421 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.198398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xj26g/must-gather-kt9cl"
Sep 17 23:45:10.472448 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.472423    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xj26g/must-gather-kt9cl"]
Sep 17 23:45:10.474701 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:45:10.474674    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e80d928_2efa_483f_9329_e8116e27a731.slice/crio-5a9277dc2b4bf989c30fd7cc0be116f8efe9af237b93b75f7155145e3a4d26ed WatchSource:0}: Error finding container 5a9277dc2b4bf989c30fd7cc0be116f8efe9af237b93b75f7155145e3a4d26ed: Status 404 returned error can't find the container with id 5a9277dc2b4bf989c30fd7cc0be116f8efe9af237b93b75f7155145e3a4d26ed
Sep 17 23:45:10.930020 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:10.929989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xj26g/must-gather-kt9cl" event={"ID":"8e80d928-2efa-483f-9329-e8116e27a731","Type":"ContainerStarted","Data":"5a9277dc2b4bf989c30fd7cc0be116f8efe9af237b93b75f7155145e3a4d26ed"}
Sep 17 23:45:11.936750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:11.936705    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xj26g/must-gather-kt9cl" event={"ID":"8e80d928-2efa-483f-9329-e8116e27a731","Type":"ContainerStarted","Data":"194801890bbc8033aaadcfe9b2bcea9f84b607d3b107eaef2d52b4762df29993"}
Sep 17 23:45:11.937177 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:11.936764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xj26g/must-gather-kt9cl" event={"ID":"8e80d928-2efa-483f-9329-e8116e27a731","Type":"ContainerStarted","Data":"31c493a58893a016ee218f5fe7e8948da1e485e29b693327ae1b403834c7d487"}
Sep 17 23:45:11.952853 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:11.952791    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xj26g/must-gather-kt9cl" podStartSLOduration=2.340357198 podStartE2EDuration="2.952771175s" totalImagesPullingTime="612.413977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 23:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:45:11.951551852 +0000 UTC m=+2350.830067100" watchObservedRunningTime="2026-09-17 23:45:11.952771175 +0000 UTC m=+2350.831286422"
Sep 17 23:45:12.817410 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:12.817379    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9bc9s_0e212fef-9eb1-4b39-95dd-2f500579ff73/global-pull-secret-syncer/0.log"
Sep 17 23:45:13.020419 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:13.020386    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vq4xx_a36f5855-8bb2-4208-87b9-ab66292212a3/konnectivity-agent/0.log"
Sep 17 23:45:13.063540 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:13.063509    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-33.ec2.internal_f1921d7596feedc2338fdc3de110f547/haproxy/0.log"
Sep 17 23:45:17.578206 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:17.578175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-s5zrk_389d3610-b781-4197-a77e-feefa7c9de91/manager/0.log"
Sep 17 23:45:17.712959 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:17.712926    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5j6tz_729bf33e-0012-401f-895d-d14318e1fb81/limitador/0.log"
Sep 17 23:45:17.780677 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:17.780630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-hb98l_230f8556-1fa7-45fc-88d5-02890c8861f8/manager/0.log"
Sep 17 23:45:19.272359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:19.272280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-gr2ww_0c9cf990-bfdc-4805-93c7-03a0ea99e72a/cluster-monitoring-operator/0.log"
Sep 17 23:45:19.524085 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:19.523986    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phh7_6704d067-80b4-45d5-9ce6-9d70cf494827/node-exporter/0.log"
Sep 17 23:45:19.546607 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:19.546582    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phh7_6704d067-80b4-45d5-9ce6-9d70cf494827/kube-rbac-proxy/0.log"
Sep 17 23:45:19.569942 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:19.569919    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9phh7_6704d067-80b4-45d5-9ce6-9d70cf494827/init-textfile/0.log"
Sep 17 23:45:20.037425 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:20.037386    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-2cl85_5e6e0dfa-d025-4abd-b4ff-ac49954de4b8/prometheus-operator-admission-webhook/0.log"
Sep 17 23:45:21.719010 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:21.718979    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-mpvwd_e4400476-2bbd-436e-8320-eb0ebfa05c3b/networking-console-plugin/0.log"
Sep 17 23:45:22.341496 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.341472    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/1.log"
Sep 17 23:45:22.349520 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.349497    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-nf7ww_c431891f-26ac-4ca7-a0d6-7d761de8f49f/console-operator/2.log"
Sep 17 23:45:22.816378 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.816346    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"]
Sep 17 23:45:22.824276 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.824250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.832455 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.832424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"]
Sep 17 23:45:22.945318 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.945259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-proc\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.945514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.945346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bxgh\" (UniqueName: \"kubernetes.io/projected/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-kube-api-access-7bxgh\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.945514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.945454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-lib-modules\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.945514 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.945496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-sys\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.945745 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.945535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-podres\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:22.965661 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:22.965631    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-6r2dn_1a808b69-c53d-4971-8608-64ef20c0e330/download-server/0.log"
Sep 17 23:45:23.046296 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bxgh\" (UniqueName: \"kubernetes.io/projected/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-kube-api-access-7bxgh\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.046598 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-lib-modules\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.046747 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-sys\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.046859 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-podres\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.046993 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-podres\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.047183 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-lib-modules\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.047290 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-proc\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.047428 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.047031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-proc\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.047538 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.046886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-sys\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.056134 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.056110    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bxgh\" (UniqueName: \"kubernetes.io/projected/a9ebc776-5ad6-4ca1-89b9-e82cb0363490-kube-api-access-7bxgh\") pod \"perf-node-gather-daemonset-t47xq\" (UID: \"a9ebc776-5ad6-4ca1-89b9-e82cb0363490\") " pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.138908 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.138826    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:23.425726 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.425686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"]
Sep 17 23:45:23.430610 ip-10-0-133-33 kubenswrapper[2581]: W0917 23:45:23.430581    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9ebc776_5ad6_4ca1_89b9_e82cb0363490.slice/crio-25999e74a8d56548c6e2992363ad0799daecf201706a0411d3f4354e18a18fb7 WatchSource:0}: Error finding container 25999e74a8d56548c6e2992363ad0799daecf201706a0411d3f4354e18a18fb7: Status 404 returned error can't find the container with id 25999e74a8d56548c6e2992363ad0799daecf201706a0411d3f4354e18a18fb7
Sep 17 23:45:23.653890 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:23.653844    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-26rbc_9a408a4e-74a9-47b8-ba1d-cb0b13bc1074/volume-data-source-validator/0.log"
Sep 17 23:45:24.032929 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.032885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq" event={"ID":"a9ebc776-5ad6-4ca1-89b9-e82cb0363490","Type":"ContainerStarted","Data":"46273c3df7b449861fa72c9dad9d7c6b5f9b5c6968208ec585d98281a5cf958c"}
Sep 17 23:45:24.033433 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.032954    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq" event={"ID":"a9ebc776-5ad6-4ca1-89b9-e82cb0363490","Type":"ContainerStarted","Data":"25999e74a8d56548c6e2992363ad0799daecf201706a0411d3f4354e18a18fb7"}
Sep 17 23:45:24.033609 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.033590    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:24.052613 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.052565    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq" podStartSLOduration=2.052545026 podStartE2EDuration="2.052545026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 23:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 23:45:24.049680502 +0000 UTC m=+2362.928195751" watchObservedRunningTime="2026-09-17 23:45:24.052545026 +0000 UTC m=+2362.931060307"
Sep 17 23:45:24.807728 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.807691    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qf8fb_83144408-58fc-403f-84b6-350fc3b586fc/dns/0.log"
Sep 17 23:45:24.829003 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.828973    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qf8fb_83144408-58fc-403f-84b6-350fc3b586fc/kube-rbac-proxy/0.log"
Sep 17 23:45:24.943624 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:24.943594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzxrn_af3cdbb3-17f7-4ce9-8bc0-cd4954ca56ac/dns-node-resolver/0.log"
Sep 17 23:45:25.524272 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:25.524245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f4x8q_f5956530-c1d2-4a28-9fb6-01eb44512b32/node-ca/0.log"
Sep 17 23:45:27.282964 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:27.282938    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8d65647-rj8qn_3a5fb108-a3e1-4326-968f-d854ea5f38f0/kube-auth-proxy/0.log"
Sep 17 23:45:27.429170 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:27.429140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454dbbfc8-27mq8_ffa416ac-87d1-4c73-b12e-f8b20f487184/router/0.log"
Sep 17 23:45:28.319611 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:28.319571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fwvkr_496c7bf5-150e-4375-a256-46ad515115e1/serve-healthcheck-canary/0.log"
Sep 17 23:45:28.820071 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:28.820021    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-p26gf_86a8e584-bf3b-491c-9d3a-4af608a972e2/insights-operator/0.log"
Sep 17 23:45:28.821383 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:28.821353    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-6f9c644dd9-p26gf_86a8e584-bf3b-491c-9d3a-4af608a972e2/insights-operator/1.log"
Sep 17 23:45:28.980855 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:28.980808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zll26_8ee32f4a-11a3-42b0-9ada-a541e27ee165/kube-rbac-proxy/0.log"
Sep 17 23:45:29.003359 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:29.003332    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zll26_8ee32f4a-11a3-42b0-9ada-a541e27ee165/exporter/0.log"
Sep 17 23:45:29.023948 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:29.023924    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zll26_8ee32f4a-11a3-42b0-9ada-a541e27ee165/extractor/0.log"
Sep 17 23:45:31.058537 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:31.058505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xj26g/perf-node-gather-daemonset-t47xq"
Sep 17 23:45:31.109487 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:31.109461    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zgdh8_86a199ad-6b4d-41ea-965a-e3c03443db9d/manager/0.log"
Sep 17 23:45:31.459208 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:31.459173    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-qkcbv_41579c73-5001-400e-9bf9-f05acd5d2890/manager/0.log"
Sep 17 23:45:31.769986 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:31.769906    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5976b594-9gf4w_97047ff6-810a-453c-bc81-14f8590e4af3/manager/0.log"
Sep 17 23:45:31.786750 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:31.786724    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5976b594-9gf4w_97047ff6-810a-453c-bc81-14f8590e4af3/copy-manifests/0.log"
Sep 17 23:45:33.476235 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:33.476192    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8d65647-rj8qn_3a5fb108-a3e1-4326-968f-d854ea5f38f0/kube-auth-proxy/0.log"
Sep 17 23:45:33.575213 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:33.575140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454dbbfc8-27mq8_ffa416ac-87d1-4c73-b12e-f8b20f487184/router/0.log"
Sep 17 23:45:35.937358 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:35.937309    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8d65647-rj8qn_3a5fb108-a3e1-4326-968f-d854ea5f38f0/kube-auth-proxy/0.log"
Sep 17 23:45:36.050221 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:36.049872    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6454dbbfc8-27mq8_ffa416ac-87d1-4c73-b12e-f8b20f487184/router/0.log"
Sep 17 23:45:38.225415 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:38.225385    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-hwkhc_11f90086-5fc0-4c5d-ab4d-6d28187626e5/migrator/0.log"
Sep 17 23:45:38.258903 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:38.258856    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-hwkhc_11f90086-5fc0-4c5d-ab4d-6d28187626e5/graceful-termination/0.log"
Sep 17 23:45:38.655525 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:38.655493    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-26ccp_33529c70-632d-4090-931b-a861615b2f78/kube-storage-version-migrator-operator/1.log"
Sep 17 23:45:38.656341 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:38.656322    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-26ccp_33529c70-632d-4090-931b-a861615b2f78/kube-storage-version-migrator-operator/0.log"
Sep 17 23:45:39.633766 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:39.633738    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4bh9x_8af74d70-08e1-4c49-9d14-1d2cc08bd6db/kube-multus/0.log"
Sep 17 23:45:39.985203 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:39.985179    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/kube-multus-additional-cni-plugins/0.log"
Sep 17 23:45:40.006564 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.006540    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/egress-router-binary-copy/0.log"
Sep 17 23:45:40.027246 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.027223    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/cni-plugins/0.log"
Sep 17 23:45:40.048437 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.048413    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/bond-cni-plugin/0.log"
Sep 17 23:45:40.068511 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.068476    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/routeoverride-cni/0.log"
Sep 17 23:45:40.088337 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.088316    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/whereabouts-cni-bincopy/0.log"
Sep 17 23:45:40.108319 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.108293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s7kvw_2f43e326-7d27-4547-931f-3b25540b849e/whereabouts-cni/0.log"
Sep 17 23:45:40.285911 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.285824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mm4gc_bba79b0b-9db3-4ab5-90db-9881c2898a54/network-metrics-daemon/0.log"
Sep 17 23:45:40.303506 ip-10-0-133-33 kubenswrapper[2581]: I0917 23:45:40.303481    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mm4gc_bba79b0b-9db3-4ab5-90db-9881c2898a54/kube-rbac-proxy/0.log"