Sep 06 01:07:11.306676 ip-10-0-132-189 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 06 01:07:11.306686 ip-10-0-132-189 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 06 01:07:11.306693 ip-10-0-132-189 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 06 01:07:11.306836 ip-10-0-132-189 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 06 01:07:21.532080 ip-10-0-132-189 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 06 01:07:21.532096 ip-10-0-132-189 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 18d8f80614c045b0ae7ee6c7c076bafd --
Sep 06 01:08:51.547435 ip-10-0-132-189 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 01:08:51.987627 ip-10-0-132-189 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:08:51.987627 ip-10-0-132-189 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 01:08:51.987627 ip-10-0-132-189 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:08:51.987627 ip-10-0-132-189 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 01:08:51.987627 ip-10-0-132-189 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 01:08:51.990561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.990474    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 01:08:51.994813 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994797    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:51.994813 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994812    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994816    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994820    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994854    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994858    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994860    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994863    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994866    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994870    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994872    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994875    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994879    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994881    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994884    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994887    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:51.994882 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994890    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994893    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994896    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994899    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994902    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994904    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994907    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994917    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994920    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994923    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994925    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994928    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994931    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994933    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994939    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994943    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994946    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994949    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994952    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:51.995257 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994955    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994958    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994960    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994963    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994965    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994968    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994971    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994973    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994976    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994978    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994981    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994984    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994987    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994990    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994993    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.994998    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995002    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995005    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995008    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:51.995751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995011    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995014    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995017    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995020    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995023    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995025    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995028    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995031    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995033    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995036    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995039    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995041    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995044    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995046    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995049    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995052    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995054    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995058    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995061    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:51.996223 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995066    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995069    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995072    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995074    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995078    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995080    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995083    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995086    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995088    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995093    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995096    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995098    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995115    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995118    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995121    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995124    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995126    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995129    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995132    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995134    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995137    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:51.996683 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995139    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995142    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995144    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995147    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995149    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995849    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995855    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995858    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995861    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995863    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995872    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995874    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995878    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995882    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995886    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995889    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995892    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995895    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995899    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:51.997204 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995903    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995907    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995909    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995912    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995915    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995917    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995920    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995922    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995925    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995928    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995930    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995933    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995935    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995938    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995940    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995943    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995946    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995948    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995950    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995953    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:51.997673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995955    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995958    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995960    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995963    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995970    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995973    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995975    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995979    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995981    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995984    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995986    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995989    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995992    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995995    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.995997    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996000    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996003    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996007    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996010    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996013    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:51.998173 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996016    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996018    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996021    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996023    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996026    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996029    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996032    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996034    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996037    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996039    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996042    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996044    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996047    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996049    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996052    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996054    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996057    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996065    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996068    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:51.998665 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996070    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996073    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996076    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996079    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996082    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996085    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996087    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996090    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996094    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996096    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996121    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996124    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996126    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996129    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996132    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996135    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996137    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996139    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996142    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996145    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:51.999146 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996148    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996151    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996153    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996156    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996158    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996161    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996548    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996552    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996555    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996558    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996561    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996564    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996566    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996570    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996572    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996575    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996578    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996580    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996583    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996585    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:51.999626 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996590    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996593    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996596    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996599    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996602    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996605    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996608    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996611    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996614    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996617    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996620    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996622    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996625    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996628    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996630    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996633    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996635    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996638    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996641    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996643    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:52.000123 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996646    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996648    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996651    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996653    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996656    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996659    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996661    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996664    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996667    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996669    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996672    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996674    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996677    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996679    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996682    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996685    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996687    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996690    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996693    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996696    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:52.000648 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996698    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996701    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996704    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996706    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996709    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996711    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996714    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996716    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996719    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996721    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996724    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996726    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996729    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996732    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996734    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996736    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996739    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996742    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996744    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996747    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:52.001136 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996749    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996752    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996755    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996757    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996760    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996762    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996765    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996767    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996770    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996772    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996775    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996777    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996780    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996783    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996829    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996834    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996837    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996840    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996844    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:52.001633 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996848    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996851    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996854    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996857    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996860    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.996863    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996934    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996964    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996971    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996975    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996981    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996984    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996991    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996995    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.996999    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997002    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997005    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997009    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997012    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997015    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997018    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997021    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997023    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 01:08:52.002141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997026    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997031    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997034    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997037    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997040    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997043    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997047    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997050    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997053    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997056    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997059    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997065    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997068    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997071    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997074    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997078    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997081    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997084    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997087    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997090    2557 flags.go:64] FLAG: --enable-server="true"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997093    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997098    2557 flags.go:64] FLAG: --event-burst="100"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997115    2557 flags.go:64] FLAG: --event-qps="50"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997119    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 01:08:52.002712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997122    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997125    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997128    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997131    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997134    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997137    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997140    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997143    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997145    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997148    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997151    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997154    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997156    2557 flags.go:64] FLAG: --feature-gates=""
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997160    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997163    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997166    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997169    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997172    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997175    2557 flags.go:64] FLAG: --help="false"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997180    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997183    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997186    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997189    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997192    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 01:08:52.003305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997195    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997198    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997201    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997203    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997206    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997211    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997215    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997218    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997221    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997224    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997227    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997230    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997233    2557 flags.go:64] FLAG: --lock-file=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997236    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997238    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997241    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997247    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997249    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997252    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997255    2557 flags.go:64] FLAG: --logging-format="text"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997258    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997261    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997264    2557 flags.go:64] FLAG: --manifest-url=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997267    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997271    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 01:08:52.003924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997274    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997278    2557 flags.go:64] FLAG: --max-pods="110"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997282    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997285    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997287    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997290    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997293    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997296    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997299    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997306    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997309    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997312    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997316    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997319    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997324    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997327    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997330    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997333    2557 flags.go:64] FLAG: --port="10250"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997336    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997339    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058449aadcf1b6927"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997342    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997345    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997348    2557 flags.go:64] FLAG: --register-node="true"
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997359    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 06 01:08:52.004572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997363    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997366    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997369    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997372    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997379    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997382    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997385    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997388    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997391    2557 flags.go:64] FLAG: --runonce="false"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997393    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997398    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997401    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997404    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997407    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997411    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997414    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997417    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997420    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997423    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997426    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997429    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997433    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997439    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997442    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997448    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 01:08:52.005247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997451    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997453    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997458    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997461    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997464    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997467    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997470    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997473    2557 flags.go:64] FLAG: --v="2"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997477    2557 flags.go:64] FLAG: --version="false"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997480    2557 flags.go:64] FLAG: --vmodule=""
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997484    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.997487    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997613    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997616    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997620    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997624    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997628    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997636    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997640    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997643    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997646    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:52.005900 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997649    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997651    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997654    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997656    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997659    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997662    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997665    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997669    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997671    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997675    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997678    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997681    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997683    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997686    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997689    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997692    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997694    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997697    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997700    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997702    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:52.006433 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997705    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997707    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997710    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997712    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997715    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997717    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997721    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997724    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997728    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997731    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997734    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997736    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997739    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997741    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997744    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997746    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997749    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997751    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997754    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997759    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:52.006911 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997761    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997764    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997767    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997770    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997773    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997776    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997778    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997781    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997783    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997786    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997788    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997791    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997794    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997796    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997799    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997801    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997804    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997807    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997809    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997812    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:52.007424 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997815    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997818    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997820    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997823    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997825    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997828    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997830    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997833    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997835    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997838    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997840    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997845    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997847    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997850    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997853    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997856    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997863    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997866    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997868    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997871    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:52.007925 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997874    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997877    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997880    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997882    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997885    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997887    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997890    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997892    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997895    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:51.997898    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:51.998640    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.007228    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.007246    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.008181    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.008188    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 01:08:52.008432 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008266    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008272    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008276    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008279    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008282    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008286    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008290    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008293    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008296    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008299    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008302    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008305    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008307    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008310    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008313    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008316    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008319    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008321    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008324    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008327    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:52.008814 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008329    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008332    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008335    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008337    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008340    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008343    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008345    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008348    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008352    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008361    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008363    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008366    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008369    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008372    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008375    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008379    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008383    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008385    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008388    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:52.009375 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008391    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008394    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008397    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008400    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008403    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008405    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008408    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008411    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008413    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008416    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008419    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008421    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008424    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008426    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008429    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008431    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008434    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008436    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008439    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008442    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:52.009839 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008445    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008448    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008451    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008459    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008462    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008464    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008467    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008469    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008472    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008474    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008477    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008480    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008482    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008485    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008487    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008490    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008492    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008495    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008498    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008501    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:52.010336 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008503    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008506    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008508    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008511    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008513    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008516    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008519    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008521    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008524    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008526    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008529    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008532    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008534    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008537    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008539    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008542    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008551    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008554    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008558    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:52.010841 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008561    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.008567    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008719    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008724    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008727    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008730    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008733    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008736    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008738    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008740    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008743    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008746    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008749    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008751    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008754    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 01:08:52.011312 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008757    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008759    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008761    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008764    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008767    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008769    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008772    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008774    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008777    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008780    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008782    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008786    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008789    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008792    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008794    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008802    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008805    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008808    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008811    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 01:08:52.011675 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008813    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008816    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008818    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008821    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008824    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008827    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008829    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008832    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008834    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008837    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008839    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008842    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008844    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008847    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008849    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008852    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008856    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008859    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008862    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008865    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 01:08:52.012211 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008868    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008871    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008874    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008877    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008879    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008882    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008884    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008887    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008890    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008898    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008900    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008903    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008905    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008908    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008911    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008913    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008916    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008919    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008921    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008924    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 01:08:52.012693 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008926    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008929    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008932    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008934    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008937    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008939    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008942    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008944    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008947    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008949    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008952    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008954    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008957    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008960    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008964    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008967    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008970    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008973    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008976    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 01:08:52.013406 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008978    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008981    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008984    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008992    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.008995    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.009003    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.009006    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:52.009009    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.009014    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.009182    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.011792    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.012875    2557 server.go:1019] "Starting client certificate rotation"
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.012988    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:08:52.013877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.013040    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 01:08:52.015745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.015730    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:08:52.023639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.023613    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 01:08:52.034257 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.034236    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 06 01:08:52.037860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.037844    2557 log.go:25] "Validated CRI v1 image API"
Sep 06 01:08:52.038784 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.038764    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 01:08:52.043634 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.043609    2557 fs.go:135] Filesystem UUIDs: map[2da783a1-8529-4bf9-b229-732b498423fb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 84ff65a1-e300-4595-ae4a-4ba5197eb185:/dev/nvme0n1p3]
Sep 06 01:08:52.043735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.043632    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 01:08:52.046543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.046521    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:08:52.048902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.048793    2557 manager.go:216] Machine: {Timestamp:2026-09-06 01:08:52.047435885 +0000 UTC m=+0.372855854 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098889 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec236e1d02cbebcf59ba9d442b753c1f SystemUUID:ec236e1d-02cb-ebcf-59ba-9d442b753c1f BootID:18d8f806-14c0-45b0-ae7e-e6c7c076bafd Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:e9:7a:c4:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:e9:7a:c4:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:c1:80:34:df:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 01:08:52.048902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.048896    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 01:08:52.049066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.049001    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 01:08:52.052451 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.052421    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 01:08:52.052630 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.052453    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 01:08:52.053361 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.053333    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 01:08:52.053455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.053366    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 01:08:52.053455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.053378    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:08:52.053455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.053398    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 01:08:52.055319 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.055307    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 01:08:52.060025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060011    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:08:52.060198 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060186    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 01:08:52.060236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060221    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 01:08:52.060236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060232    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 01:08:52.060302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060244    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 01:08:52.060302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060255    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 06 01:08:52.060302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060264    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 01:08:52.060658 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060645    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:08:52.060701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.060671    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 01:08:52.063186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.063167    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 01:08:52.067592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067569    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 01:08:52.067702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067615    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 01:08:52.067895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067881    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 01:08:52.067948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067904    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 01:08:52.067948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067913    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 01:08:52.067948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067920    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 01:08:52.067948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067932    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 01:08:52.067948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.067940    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 01:08:52.068459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068437    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 01:08:52.068518 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068465    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 01:08:52.068518 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068484    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 01:08:52.068518 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068494    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 01:08:52.068518 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068509    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 01:08:52.068710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.068521    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 01:08:52.069942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.069919    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 01:08:52.069942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.069942    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 01:08:52.072029 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.072001    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 01:08:52.072142 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.072057    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 01:08:52.072198 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.072164    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 01:08:52.075003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.074989    2557 server.go:1268] "Started kubelet"
Sep 06 01:08:52.075074 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.075048    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 01:08:52.075189 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.075146    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 01:08:52.075241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.075211    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 01:08:52.075827 ip-10-0-132-189 systemd[1]: Started Kubernetes Kubelet.
Sep 06 01:08:52.077220 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.077176    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 01:08:52.077379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.077363    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 01:08:52.079695 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.079675    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 01:08:52.081046 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.079875    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-189.ec2.internal.18d29600c55e1a11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-189.ec2.internal,UID:ip-10-0-132-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-189.ec2.internal,},FirstTimestamp:2026-09-06 01:08:52.074953233 +0000 UTC m=+0.400373201,LastTimestamp:2026-09-06 01:08:52.074953233 +0000 UTC m=+0.400373201,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-189.ec2.internal,}"
Sep 06 01:08:52.082560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.082546    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 01:08:52.082629 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.082558    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 01:08:52.082684 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.082626    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.083602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083435    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 01:08:52.083602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083451    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 01:08:52.083602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083540    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 01:08:52.083602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083550    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 01:08:52.083602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083600    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 01:08:52.083866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083798    2557 factory.go:55] Registering systemd factory
Sep 06 01:08:52.083866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.083820    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 06 01:08:52.084574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084392    2557 factory.go:153] Registering CRI-O factory
Sep 06 01:08:52.084574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084411    2557 factory.go:223] Registration of the crio container factory successfully
Sep 06 01:08:52.084574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084476    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 01:08:52.084574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084500    2557 factory.go:103] Registering Raw factory
Sep 06 01:08:52.084574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084514    2557 manager.go:1196] Started watching for new ooms in manager
Sep 06 01:08:52.084977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.084960    2557 manager.go:349] Starting recovery of all containers
Sep 06 01:08:52.096009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.095959    2557 manager.go:354] Recovery completed
Sep 06 01:08:52.097688 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.097652    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 01:08:52.097775 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.097681    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 01:08:52.098908 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.098875    2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 06 01:08:52.098997 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.098918    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnq8r"
Sep 06 01:08:52.102050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.102034    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.104188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104172    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.104270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104201    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.104270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104212    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.104837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104820    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 01:08:52.104837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104835    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 01:08:52.104837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104838    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.104975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.104854    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 01:08:52.105562 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.105547    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.105602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.105575    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.105602 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.105584    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.106693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.106680    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnq8r"
Sep 06 01:08:52.106964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.106952    2557 policy_none.go:49] "None policy: Start"
Sep 06 01:08:52.107005 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.106969    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 01:08:52.107005 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.106979    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 01:08:52.109618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.109607    2557 policy_none.go:47] "Start"
Sep 06 01:08:52.155071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.155046    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.155797    2557 manager.go:337] "Starting Device Plugin manager"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.155837    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.155850    2557 server.go:87] "Starting device plugin registration server"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156122    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156137    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156260    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156415    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156444    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156454    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156496    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.156524    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.156568    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.156906    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.156959    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.165751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.158575    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:52.257389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.257144    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.257389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.257163    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"]
Sep 06 01:08:52.257555 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.257454    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.258359 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258343    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.258462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258381    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.258462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258395    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.258462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258343    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.258462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258450    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.258462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258461    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.258685 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.258481    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.260906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.260891    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.261045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.261098 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261060    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.261691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261675    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.261771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261704    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.261771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261715    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.261771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261676    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.261902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261781    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.261902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.261797    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.264056 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.264040    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.264159 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.264068    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 01:08:52.264794 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.264777    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 01:08:52.264881 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.264808    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 01:08:52.264881 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.264818    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeHasSufficientPID"
Sep 06 01:08:52.267739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.267424    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.267739 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.267441    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-189.ec2.internal\": node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.284066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.284039    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a70fe34e4a8c25c4ae59d68c20a213c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-189.ec2.internal\" (UID: \"8a70fe34e4a8c25c4ae59d68c20a213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.284164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.284117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.284164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.284143    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.287849 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.287833    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-189.ec2.internal\" not found" node="ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.292412 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.292396    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-189.ec2.internal\" not found" node="ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.325866 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.325837    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.384449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384418    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.384449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384454    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.384662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a70fe34e4a8c25c4ae59d68c20a213c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-189.ec2.internal\" (UID: \"8a70fe34e4a8c25c4ae59d68c20a213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.384662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8a70fe34e4a8c25c4ae59d68c20a213c-config\") pod \"kube-apiserver-proxy-ip-10-0-132-189.ec2.internal\" (UID: \"8a70fe34e4a8c25c4ae59d68c20a213c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.384662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.384662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.384535    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/601a917c88665d3dd5c295b465b4861d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal\" (UID: \"601a917c88665d3dd5c295b465b4861d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.426746 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.426720    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.527879 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.527814    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.591398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.591363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.596967 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.596717    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.628831 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.628806    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.732315 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.732280    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.835889 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.835820    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.914457 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.914430    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:52.936849 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:52.936819    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-189.ec2.internal\" not found"
Sep 06 01:08:52.968319 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.968293    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:52.983646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.983616    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:52.994270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.994251    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:08:52.996410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:52.996396    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal"
Sep 06 01:08:53.010507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.010489    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 01:08:53.012809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.012796    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 01:08:53.012933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.012915    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:08:53.012982 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.012959    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:08:53.013018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.012959    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 01:08:53.061821 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.061794    2557 apiserver.go:52] "Watching apiserver"
Sep 06 01:08:53.081966 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.081938    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 01:08:53.082317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.082296    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cxwgr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt","openshift-cluster-node-tuning-operator/tuned-9prq8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-gn2d8","openshift-network-diagnostics/network-check-target-sqv6l","openshift-network-operator/iptables-alerter-5qp9m","openshift-ovn-kubernetes/ovnkube-node-rkl49","kube-system/konnectivity-agent-v8dvq","kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal","openshift-dns/node-resolver-58rzj","openshift-image-registry/node-ca-fllzt","openshift-multus/multus-x2ncr","openshift-multus/network-metrics-daemon-n8c6k"]
Sep 06 01:08:53.082706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.082687    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 01:08:53.084908 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.084885    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-host\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087155    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.087213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087172    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb5cr\" (UniqueName: \"kubernetes.io/projected/7135e0d4-549d-4c53-9152-5eaf817cd4aa-kube-api-access-zb5cr\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1db28da3-52e9-4c48-ac0b-69c584f20b36-serviceca\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087263    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-kubernetes\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-run\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-tuned\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-modprobe-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysconfig\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-systemd\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087433    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-lib-modules\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1db28da3-52e9-4c48-ac0b-69c584f20b36-host\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9shl\" (UniqueName: \"kubernetes.io/projected/1db28da3-52e9-4c48-ac0b-69c584f20b36-kube-api-access-h9shl\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-conf\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-sys\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087522    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-var-lib-kubelet\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087561    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-tmp\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.087740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.087596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.089422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.089405    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.090559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090539    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.090672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090564    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.090672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090586    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 01:08:53.090806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090699    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tmrkw\""
Sep 06 01:08:53.090806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090700    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hw54n\""
Sep 06 01:08:53.090806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.090788    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.092399 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.092381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.092661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.092646    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.093075 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.093055    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.093403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.093387    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.093532 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.093500    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpr2g\""
Sep 06 01:08:53.093943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.093926    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 01:08:53.095110 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095090    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:53.095246 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.095187    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:08:53.095357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zv2dw\""
Sep 06 01:08:53.095466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095405    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 01:08:53.095466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095407    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 01:08:53.095466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095460    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.095641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095514    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 01:08:53.095785 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.095768    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.097619 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.097593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.097736 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.097700    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:08:53.100939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.100916    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.101050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.101028    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 01:08:53.103662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.103644    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.105196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.105169    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 01:08:53.105266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.105200    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-snz4s\""
Sep 06 01:08:53.105266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.105173    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 01:08:53.105266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.105172    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.106280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.106262    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 01:08:53.106280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.106275    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 01:08:53.106421 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.106296    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.107507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.106824    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.107507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.106957    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dgvw6\""
Sep 06 01:08:53.107507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.107072    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 01:08:53.107689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.107649    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 01:08:53.109346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.109294    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 01:03:52 +0000 UTC" deadline="2028-02-06 23:12:43.003454514 +0000 UTC"
Sep 06 01:08:53.109346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.109341    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12454h3m49.894117454s"
Sep 06 01:08:53.110092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.110074    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.110174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.110154    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.110351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.110329    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qqfg6\""
Sep 06 01:08:53.110560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.110546    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.113508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.113491    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.113667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.113646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 01:08:53.113738 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.113693    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 01:08:53.114120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.114104    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 01:08:53.114243 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.114225    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qglvk\""
Sep 06 01:08:53.115934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.115918    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 01:08:53.116031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.116021    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhvxk\""
Sep 06 01:08:53.116386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.116367    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.116453 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.116436    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:08:53.155086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.155061    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qwf8k"
Sep 06 01:08:53.162864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.162838    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qwf8k"
Sep 06 01:08:53.185117 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.185092    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 01:08:53.187923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.187901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5sjg\" (UniqueName: \"kubernetes.io/projected/9304d545-69f3-43b2-8d14-8a81f2759e38-kube-api-access-s5sjg\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.188036 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.187929    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.188036 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.187957    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-slash\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.188036 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.187975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnl9\" (UniqueName: \"kubernetes.io/projected/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-kube-api-access-6qnl9\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.188036 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.187999    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.188201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-registration-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.188201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.188201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-kubelet-config\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.188201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188145    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-dbus\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.188201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-systemd-units\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.188415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-var-lib-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.188415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188257    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.188415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188316    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-kubernetes\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.188415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-tuned\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.188415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-k8s-cni-cncf-io\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188416    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8dcm\" (UniqueName: \"kubernetes.io/projected/e6ec8321-c4d7-4610-95d4-77cb55f218ae-kube-api-access-r8dcm\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-kubernetes\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188475    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-hosts-file\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-lib-modules\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188524    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-sys-fs\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188542    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-socket-dir-parent\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x9b7\" (UniqueName: \"kubernetes.io/projected/c383b96c-cd06-45ed-aa0b-706980aae17c-kube-api-access-6x9b7\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-bin\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-env-overrides\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-hostroot\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.188623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-lib-modules\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188656    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-multus-certs\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188734    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-host\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb5cr\" (UniqueName: \"kubernetes.io/projected/7135e0d4-549d-4c53-9152-5eaf817cd4aa-kube-api-access-zb5cr\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188765    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9e677ae-0f91-4874-9b42-24335811139d-agent-certs\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188786    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-cnibin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dhc2\" (UniqueName: \"kubernetes.io/projected/be7d1fb3-d024-433a-86a3-0dd91236e5a5-kube-api-access-9dhc2\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188710    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188838    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188838    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-host\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188839    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-kubelet\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188941    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-node-log\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.188977    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-script-lib\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4vzx\" (UniqueName: \"kubernetes.io/projected/341fd325-eeff-410b-a240-056c9e523cc4-kube-api-access-m4vzx\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-modprobe-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysconfig\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189058    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-systemd\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9shl\" (UniqueName: \"kubernetes.io/projected/1db28da3-52e9-4c48-ac0b-69c584f20b36-kube-api-access-h9shl\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189141    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-modprobe-d\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189162    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysconfig\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189182    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-netns\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189214    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-systemd\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189261    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-netd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-sys\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189371    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-tmp\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-socket-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189408    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-sys\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189419    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-conf-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189447    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-systemd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.189812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/341fd325-eeff-410b-a240-056c9e523cc4-ovn-node-metrics-cert\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189544    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlcgp\" (UniqueName: \"kubernetes.io/projected/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kube-api-access-xlcgp\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189601    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189628    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-config\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9304d545-69f3-43b2-8d14-8a81f2759e38-iptables-alerter-script\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-ovn\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1db28da3-52e9-4c48-ac0b-69c584f20b36-host\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-etc-kubernetes\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189767    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1db28da3-52e9-4c48-ac0b-69c584f20b36-host\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-conf\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189827    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-daemon-config\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-netns\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-log-socket\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-sysctl-conf\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.190580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cnibin\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.189996    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1db28da3-52e9-4c48-ac0b-69c584f20b36-serviceca\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190012    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-etc-selinux\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190028    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-system-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-cni-binary-copy\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190070    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9304d545-69f3-43b2-8d14-8a81f2759e38-host-slash\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190088    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-etc-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190107    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-run\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190180    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9e677ae-0f91-4874-9b42-24335811139d-konnectivity-ca\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190227    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-device-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-bin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190269    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-kubelet\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-tmp-dir\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-run\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-var-lib-kubelet\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.191293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190374    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-multus\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.191971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7135e0d4-549d-4c53-9152-5eaf817cd4aa-var-lib-kubelet\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.191971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.190493    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1db28da3-52e9-4c48-ac0b-69c584f20b36-serviceca\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.192658 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.192638    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-etc-tuned\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.192658 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.192645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7135e0d4-549d-4c53-9152-5eaf817cd4aa-tmp\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.201666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.201645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb5cr\" (UniqueName: \"kubernetes.io/projected/7135e0d4-549d-4c53-9152-5eaf817cd4aa-kube-api-access-zb5cr\") pod \"tuned-9prq8\" (UID: \"7135e0d4-549d-4c53-9152-5eaf817cd4aa\") " pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.201855 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.201837    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9shl\" (UniqueName: \"kubernetes.io/projected/1db28da3-52e9-4c48-ac0b-69c584f20b36-kube-api-access-h9shl\") pod \"node-ca-fllzt\" (UID: \"1db28da3-52e9-4c48-ac0b-69c584f20b36\") " pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.245797 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.245772    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:53.288518 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.288489    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a70fe34e4a8c25c4ae59d68c20a213c.slice/crio-46ca61ad522a288d621a2d445fdd6ec95dc0e6e2bb1ba7ad176b7c211bdb9e15 WatchSource:0}: Error finding container 46ca61ad522a288d621a2d445fdd6ec95dc0e6e2bb1ba7ad176b7c211bdb9e15: Status 404 returned error can't find the container with id 46ca61ad522a288d621a2d445fdd6ec95dc0e6e2bb1ba7ad176b7c211bdb9e15
Sep 06 01:08:53.289785 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.289762    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod601a917c88665d3dd5c295b465b4861d.slice/crio-62f01bd7abf5a9f18ae0dad5b7a99376a042f4894ffa70a9ae915edff940e342 WatchSource:0}: Error finding container 62f01bd7abf5a9f18ae0dad5b7a99376a042f4894ffa70a9ae915edff940e342: Status 404 returned error can't find the container with id 62f01bd7abf5a9f18ae0dad5b7a99376a042f4894ffa70a9ae915edff940e342
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291056    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-netns\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291085    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291107    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-netd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291146    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-socket-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-conf-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291194    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-systemd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/341fd325-eeff-410b-a240-056c9e523cc4-ovn-node-metrics-cert\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291266    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlcgp\" (UniqueName: \"kubernetes.io/projected/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kube-api-access-xlcgp\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291342    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-config\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9304d545-69f3-43b2-8d14-8a81f2759e38-iptables-alerter-script\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-ovn\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291425    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-etc-kubernetes\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.292231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-daemon-config\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-netns\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-log-socket\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291579    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cnibin\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291637    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-etc-selinux\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291669    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-system-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-cni-binary-copy\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9304d545-69f3-43b2-8d14-8a81f2759e38-host-slash\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-etc-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291782    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9e677ae-0f91-4874-9b42-24335811139d-konnectivity-ca\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-device-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-bin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291913    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-kubelet\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-tmp-dir\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.293416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291963    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-multus\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.291993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5sjg\" (UniqueName: \"kubernetes.io/projected/9304d545-69f3-43b2-8d14-8a81f2759e38-kube-api-access-s5sjg\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-slash\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnl9\" (UniqueName: \"kubernetes.io/projected/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-kube-api-access-6qnl9\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292132    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-registration-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-kubelet-config\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-dbus\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-systemd-units\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-var-lib-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292297    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cnibin\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-netns\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292384    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292398    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-multus\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.294294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292540    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-k8s-cni-cncf-io\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8dcm\" (UniqueName: \"kubernetes.io/projected/e6ec8321-c4d7-4610-95d4-77cb55f218ae-kube-api-access-r8dcm\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292573    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-netns\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292608    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-hosts-file\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292619    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-conf-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.292650    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292653    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-ovn\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-hosts-file\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292708    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-etc-kubernetes\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.292735    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:08:53.792710856 +0000 UTC m=+2.118130823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292762    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-kubelet-config\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-slash\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292841    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-log-socket\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292878    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-var-lib-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9304d545-69f3-43b2-8d14-8a81f2759e38-iptables-alerter-script\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.295191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.292543    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-systemd-units\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293177    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-k8s-cni-cncf-io\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293241    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-dbus\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293267    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-config\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-binary-copy\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293298    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-etc-selinux\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293308    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-sys-fs\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-socket-dir-parent\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-socket-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-socket-dir-parent\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x9b7\" (UniqueName: \"kubernetes.io/projected/c383b96c-cd06-45ed-aa0b-706980aae17c-kube-api-access-6x9b7\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293402    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-netd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-bin\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-sys-fs\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293457    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-env-overrides\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.295926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-hostroot\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-multus-certs\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293510    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-system-cni-dir\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293519    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.293526    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293529    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-kubelet\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9e677ae-0f91-4874-9b42-24335811139d-agent-certs\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-run-systemd\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293456    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-device-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-etc-openvswitch\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293582    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-registration-dir\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.293588    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:53.793570726 +0000 UTC m=+2.118990710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293290    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-multus-daemon-config\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293635    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-cnibin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dhc2\" (UniqueName: \"kubernetes.io/projected/be7d1fb3-d024-433a-86a3-0dd91236e5a5-kube-api-access-9dhc2\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293702    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-kubelet\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-node-log\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.296689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-var-lib-cni-bin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293760    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-script-lib\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4vzx\" (UniqueName: \"kubernetes.io/projected/341fd325-eeff-410b-a240-056c9e523cc4-kube-api-access-m4vzx\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.293953    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-host-run-multus-certs\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-node-log\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f9e677ae-0f91-4874-9b42-24335811139d-konnectivity-ca\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-kubelet\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/341fd325-eeff-410b-a240-056c9e523cc4-host-cni-bin\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294300    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be7d1fb3-d024-433a-86a3-0dd91236e5a5-system-cni-dir\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294334    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-ovnkube-script-lib\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-hostroot\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294410    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9304d545-69f3-43b2-8d14-8a81f2759e38-host-slash\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294627    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be7d1fb3-d024-433a-86a3-0dd91236e5a5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/341fd325-eeff-410b-a240-056c9e523cc4-env-overrides\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294723    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-tmp-dir\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.294781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c383b96c-cd06-45ed-aa0b-706980aae17c-cnibin\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.297520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.295169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c383b96c-cd06-45ed-aa0b-706980aae17c-cni-binary-copy\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.298317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.296057    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/341fd325-eeff-410b-a240-056c9e523cc4-ovn-node-metrics-cert\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.298317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.296596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f9e677ae-0f91-4874-9b42-24335811139d-agent-certs\") pod \"konnectivity-agent-v8dvq\" (UID: \"f9e677ae-0f91-4874-9b42-24335811139d\") " pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.298317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.296654    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:08:53.302035 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.302018    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:08:53.302035 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.302037    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:08:53.302147 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.302047    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:53.302147 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.302120    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:53.802107656 +0000 UTC m=+2.127527618 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:53.313490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.313460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x9b7\" (UniqueName: \"kubernetes.io/projected/c383b96c-cd06-45ed-aa0b-706980aae17c-kube-api-access-6x9b7\") pod \"multus-x2ncr\" (UID: \"c383b96c-cd06-45ed-aa0b-706980aae17c\") " pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.313592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.313511    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dhc2\" (UniqueName: \"kubernetes.io/projected/be7d1fb3-d024-433a-86a3-0dd91236e5a5-kube-api-access-9dhc2\") pod \"multus-additional-cni-plugins-gn2d8\" (UID: \"be7d1fb3-d024-433a-86a3-0dd91236e5a5\") " pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.313717 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.313694    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnl9\" (UniqueName: \"kubernetes.io/projected/807d79e3-0a4f-4f9a-b15c-8732a0dc08fe-kube-api-access-6qnl9\") pod \"node-resolver-58rzj\" (UID: \"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe\") " pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.315049 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.315023    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8dcm\" (UniqueName: \"kubernetes.io/projected/e6ec8321-c4d7-4610-95d4-77cb55f218ae-kube-api-access-r8dcm\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.315552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.315533    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4vzx\" (UniqueName: \"kubernetes.io/projected/341fd325-eeff-410b-a240-056c9e523cc4-kube-api-access-m4vzx\") pod \"ovnkube-node-rkl49\" (UID: \"341fd325-eeff-410b-a240-056c9e523cc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.315797 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.315781    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlcgp\" (UniqueName: \"kubernetes.io/projected/2eca0e58-9b14-4b3e-a76b-20bdfee94f69-kube-api-access-xlcgp\") pod \"aws-ebs-csi-driver-node-gklkt\" (UID: \"2eca0e58-9b14-4b3e-a76b-20bdfee94f69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.316522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.316500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5sjg\" (UniqueName: \"kubernetes.io/projected/9304d545-69f3-43b2-8d14-8a81f2759e38-kube-api-access-s5sjg\") pod \"iptables-alerter-5qp9m\" (UID: \"9304d545-69f3-43b2-8d14-8a81f2759e38\") " pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.421535 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.421434    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9prq8"
Sep 06 01:08:53.434836 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.434811    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7135e0d4_549d_4c53_9152_5eaf817cd4aa.slice/crio-945f10dd8bff824d2e293a6a8ba8a3e86772952e74872f5bab81f765063231b7 WatchSource:0}: Error finding container 945f10dd8bff824d2e293a6a8ba8a3e86772952e74872f5bab81f765063231b7: Status 404 returned error can't find the container with id 945f10dd8bff824d2e293a6a8ba8a3e86772952e74872f5bab81f765063231b7
Sep 06 01:08:53.436041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.436017    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fllzt"
Sep 06 01:08:53.444699 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.444676    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1db28da3_52e9_4c48_ac0b_69c584f20b36.slice/crio-0e2d0e303181c3a2b5d4efffaa04785530300b8ec4e8547dfe627670a3e57fc6 WatchSource:0}: Error finding container 0e2d0e303181c3a2b5d4efffaa04785530300b8ec4e8547dfe627670a3e57fc6: Status 404 returned error can't find the container with id 0e2d0e303181c3a2b5d4efffaa04785530300b8ec4e8547dfe627670a3e57fc6
Sep 06 01:08:53.457861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.457837    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5qp9m"
Sep 06 01:08:53.466631 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.466606    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9304d545_69f3_43b2_8d14_8a81f2759e38.slice/crio-188b53c4e04e9a36912ba361acd02fbccaf6106063d16781772543a2a3ab9040 WatchSource:0}: Error finding container 188b53c4e04e9a36912ba361acd02fbccaf6106063d16781772543a2a3ab9040: Status 404 returned error can't find the container with id 188b53c4e04e9a36912ba361acd02fbccaf6106063d16781772543a2a3ab9040
Sep 06 01:08:53.469941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.469915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gn2d8"
Sep 06 01:08:53.479524 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.479503    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe7d1fb3_d024_433a_86a3_0dd91236e5a5.slice/crio-ba390656976a4463cbe1f040579edc3e44dcc1f5b7d25372dc5fc850bd241023 WatchSource:0}: Error finding container ba390656976a4463cbe1f040579edc3e44dcc1f5b7d25372dc5fc850bd241023: Status 404 returned error can't find the container with id ba390656976a4463cbe1f040579edc3e44dcc1f5b7d25372dc5fc850bd241023
Sep 06 01:08:53.482765 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.482749    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:08:53.490765 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.490739    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341fd325_eeff_410b_a240_056c9e523cc4.slice/crio-6bc6ec9fb48b8657872e6d79c1f281e6ec5fcd1ad4d4e2cef772c132b6d52d2c WatchSource:0}: Error finding container 6bc6ec9fb48b8657872e6d79c1f281e6ec5fcd1ad4d4e2cef772c132b6d52d2c: Status 404 returned error can't find the container with id 6bc6ec9fb48b8657872e6d79c1f281e6ec5fcd1ad4d4e2cef772c132b6d52d2c
Sep 06 01:08:53.499451 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.499427    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:08:53.507914 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.507894    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e677ae_0f91_4874_9b42_24335811139d.slice/crio-e06899c26552901d8bb542fdf4f777bfbbacf1619185c73b4047f1c134a1394b WatchSource:0}: Error finding container e06899c26552901d8bb542fdf4f777bfbbacf1619185c73b4047f1c134a1394b: Status 404 returned error can't find the container with id e06899c26552901d8bb542fdf4f777bfbbacf1619185c73b4047f1c134a1394b
Sep 06 01:08:53.523596 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.523573    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-58rzj"
Sep 06 01:08:53.532615 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.532594    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807d79e3_0a4f_4f9a_b15c_8732a0dc08fe.slice/crio-70e14a98e6c387c6e7a4c9fc602288fb7579209a83c7cc025b1b718c23bfbfb9 WatchSource:0}: Error finding container 70e14a98e6c387c6e7a4c9fc602288fb7579209a83c7cc025b1b718c23bfbfb9: Status 404 returned error can't find the container with id 70e14a98e6c387c6e7a4c9fc602288fb7579209a83c7cc025b1b718c23bfbfb9
Sep 06 01:08:53.534367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.534343    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt"
Sep 06 01:08:53.539217 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.539199    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x2ncr"
Sep 06 01:08:53.543838 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.543817    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eca0e58_9b14_4b3e_a76b_20bdfee94f69.slice/crio-1b54795edbb1a3efa251e01c97ff3318ab7bdbb73bd6dde8b0b6dc53d9de198b WatchSource:0}: Error finding container 1b54795edbb1a3efa251e01c97ff3318ab7bdbb73bd6dde8b0b6dc53d9de198b: Status 404 returned error can't find the container with id 1b54795edbb1a3efa251e01c97ff3318ab7bdbb73bd6dde8b0b6dc53d9de198b
Sep 06 01:08:53.547629 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:08:53.547606    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc383b96c_cd06_45ed_aa0b_706980aae17c.slice/crio-93e31220fbbfdbe658dea5b7b0c6ecc8156ea84b73d19df7dfacdac6961c6223 WatchSource:0}: Error finding container 93e31220fbbfdbe658dea5b7b0c6ecc8156ea84b73d19df7dfacdac6961c6223: Status 404 returned error can't find the container with id 93e31220fbbfdbe658dea5b7b0c6ecc8156ea84b73d19df7dfacdac6961c6223
Sep 06 01:08:53.796916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.796827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:53.796916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.796892    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:53.797241 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.797002    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:53.797241 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.797036    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:53.797241 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.797093    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:54.797068979 +0000 UTC m=+3.122488941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:53.797241 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.797116    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:08:54.797103677 +0000 UTC m=+3.122523640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:53.897700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:53.897657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:53.897902 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.897885    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:08:53.897976 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.897917    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:08:53.897976 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.897931    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:53.898076 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:53.898004    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:54.897981872 +0000 UTC m=+3.223401837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:54.166450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.166328    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:03:53 +0000 UTC" deadline="2028-02-06 22:53:52.395559927 +0000 UTC"
Sep 06 01:08:54.166450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.166393    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12453h44m58.229171399s"
Sep 06 01:08:54.180211 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.180135    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal" event={"ID":"601a917c88665d3dd5c295b465b4861d","Type":"ContainerStarted","Data":"62f01bd7abf5a9f18ae0dad5b7a99376a042f4894ffa70a9ae915edff940e342"}
Sep 06 01:08:54.213702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.213591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x2ncr" event={"ID":"c383b96c-cd06-45ed-aa0b-706980aae17c","Type":"ContainerStarted","Data":"93e31220fbbfdbe658dea5b7b0c6ecc8156ea84b73d19df7dfacdac6961c6223"}
Sep 06 01:08:54.226244 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.226082    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt" event={"ID":"2eca0e58-9b14-4b3e-a76b-20bdfee94f69","Type":"ContainerStarted","Data":"1b54795edbb1a3efa251e01c97ff3318ab7bdbb73bd6dde8b0b6dc53d9de198b"}
Sep 06 01:08:54.257271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.257229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fllzt" event={"ID":"1db28da3-52e9-4c48-ac0b-69c584f20b36","Type":"ContainerStarted","Data":"0e2d0e303181c3a2b5d4efffaa04785530300b8ec4e8547dfe627670a3e57fc6"}
Sep 06 01:08:54.275878 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.274386    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal" event={"ID":"8a70fe34e4a8c25c4ae59d68c20a213c","Type":"ContainerStarted","Data":"46ca61ad522a288d621a2d445fdd6ec95dc0e6e2bb1ba7ad176b7c211bdb9e15"}
Sep 06 01:08:54.287301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.287203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-58rzj" event={"ID":"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe","Type":"ContainerStarted","Data":"70e14a98e6c387c6e7a4c9fc602288fb7579209a83c7cc025b1b718c23bfbfb9"}
Sep 06 01:08:54.306311 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.306267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v8dvq" event={"ID":"f9e677ae-0f91-4874-9b42-24335811139d","Type":"ContainerStarted","Data":"e06899c26552901d8bb542fdf4f777bfbbacf1619185c73b4047f1c134a1394b"}
Sep 06 01:08:54.319364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.319309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"6bc6ec9fb48b8657872e6d79c1f281e6ec5fcd1ad4d4e2cef772c132b6d52d2c"}
Sep 06 01:08:54.329920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.329880    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerStarted","Data":"ba390656976a4463cbe1f040579edc3e44dcc1f5b7d25372dc5fc850bd241023"}
Sep 06 01:08:54.356564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.356525    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5qp9m" event={"ID":"9304d545-69f3-43b2-8d14-8a81f2759e38","Type":"ContainerStarted","Data":"188b53c4e04e9a36912ba361acd02fbccaf6106063d16781772543a2a3ab9040"}
Sep 06 01:08:54.364301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.364271    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:54.371070 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.371041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9prq8" event={"ID":"7135e0d4-549d-4c53-9152-5eaf817cd4aa","Type":"ContainerStarted","Data":"945f10dd8bff824d2e293a6a8ba8a3e86772952e74872f5bab81f765063231b7"}
Sep 06 01:08:54.804549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.804507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:54.804749 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.804568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:54.804749 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.804651    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:54.804749 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.804730    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:56.804707343 +0000 UTC m=+5.130127301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:54.804927 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.804751    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:54.804927 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.804807    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:08:56.804791477 +0000 UTC m=+5.130211458 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:54.905945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:54.905904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:54.906200 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.906163    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:08:54.906200 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.906195    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:08:54.906350 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.906209    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:54.906350 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:54.906274    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:08:56.906255842 +0000 UTC m=+5.231675820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:55.083380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.083293    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:55.156793 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.156759    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:55.156989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.156801    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:55.156989 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:55.156891    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:08:55.156989 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:55.156968    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:08:55.157162 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.157033    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:55.157162 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:55.157141    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:08:55.167445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.167380    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 01:03:53 +0000 UTC" deadline="2028-04-04 12:44:25.772817371 +0000 UTC"
Sep 06 01:08:55.167445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.167415    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13835h35m30.605407757s"
Sep 06 01:08:55.346837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:55.346564    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 01:08:56.823582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:56.823546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:56.824033 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:56.823595    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:56.824033 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.823784    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:56.824033 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.823858    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:09:00.823834759 +0000 UTC m=+9.149254738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:08:56.824390 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.824368    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:56.824499 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.824430    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:00.824414482 +0000 UTC m=+9.149834458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:08:56.924376 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:56.924335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:56.924560 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.924520    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:08:56.924560 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.924544    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:08:56.924560 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.924557    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:56.924723 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:56.924620    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:00.924600632 +0000 UTC m=+9.250020612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:08:57.156879 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:57.156791    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:57.157050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:57.156941    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:08:57.157445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:57.157425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:57.157561 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:57.157538    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:08:57.157665 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:57.157599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:57.157736 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:57.157693    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:08:59.157601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:59.157566    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:08:59.157601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:59.157616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:08:59.157601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:08:59.157616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:08:59.158681 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:59.157694    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:08:59.158681 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:59.157792    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:08:59.158681 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:08:59.157886    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:00.861486 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:00.861448    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:00.862065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:00.861504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:00.862065 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.861665    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:00.862065 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.861724    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:09:08.861705837 +0000 UTC m=+17.187125810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:00.862065 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.861787    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:00.862065 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.861820    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:08.861808191 +0000 UTC m=+17.187228155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:00.962652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:00.962559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:00.962830 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.962755    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:00.962830 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.962773    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:00.962830 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.962785    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:00.963107 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:00.962852    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:08.962832805 +0000 UTC m=+17.288252766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:01.157689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:01.157636    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:01.157994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:01.157703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:01.157994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:01.157789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:01.157994 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:01.157805    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:01.157994 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:01.157896    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:01.158350 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:01.158004    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:03.157165 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:03.157126    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:03.157165 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:03.157165    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:03.157647 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:03.157147    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:03.157647 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:03.157281    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:03.157647 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:03.157390    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:03.157647 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:03.157473    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:05.157539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:05.157510    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:05.157943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:05.157510    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:05.157943 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:05.157614    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:05.157943 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:05.157694    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:05.157943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:05.157511    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:05.157943 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:05.157769    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:07.156906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:07.156864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:07.157362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:07.156926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:07.157362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:07.156926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:07.157362 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:07.157001    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:07.157362 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:07.157125    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:07.157362 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:07.157197    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:08.926576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:08.926546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:08.926576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:08.926580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:08.926973 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:08.926685    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:08.926973 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:08.926733    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:09:24.926717647 +0000 UTC m=+33.252137614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:08.926973 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:08.926686    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:08.926973 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:08.926765    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:24.926756938 +0000 UTC m=+33.252176921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:09.027709 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:09.027671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:09.027877 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.027802    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:09.027877 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.027817    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:09.027877 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.027826    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:09.027877 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.027875    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:25.027863958 +0000 UTC m=+33.353283913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:09.156976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:09.156898    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:09.156976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:09.156926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:09.156976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:09.156935    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:09.157258 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.157034    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:09.157258 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.157125    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:09.157258 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:09.157203    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:11.157613 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:11.157576    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:11.158216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:11.157617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:11.158216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:11.157629    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:11.158216 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:11.157728    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:11.158216 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:11.157882    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:11.158216 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:11.158000    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:13.157908 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.157578    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:13.158269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.157611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:13.158269 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:13.158031    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:13.158269 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:13.158082    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:13.158269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.157578    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:13.158269 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:13.158195    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:13.423056 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.423022    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="1b5c45ed0787d2f4ea0f63e4d47c3abee936f3128080430ba04371a9b20b8f53" exitCode=0
Sep 06 01:09:13.423236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.423133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"1b5c45ed0787d2f4ea0f63e4d47c3abee936f3128080430ba04371a9b20b8f53"}
Sep 06 01:09:13.424798 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.424776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9prq8" event={"ID":"7135e0d4-549d-4c53-9152-5eaf817cd4aa","Type":"ContainerStarted","Data":"0f4c06431480b715d9edd22b0714549191353bd5ee5de0ed74497ba7315a69ef"}
Sep 06 01:09:13.426351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.426331    2557 generic.go:356] "Generic (PLEG): container finished" podID="601a917c88665d3dd5c295b465b4861d" containerID="c4df30a13e45e50e2b458f380956f9ea621f8d73507b1dff8655d984b41c18a1" exitCode=0
Sep 06 01:09:13.426450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.426422    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal" event={"ID":"601a917c88665d3dd5c295b465b4861d","Type":"ContainerDied","Data":"c4df30a13e45e50e2b458f380956f9ea621f8d73507b1dff8655d984b41c18a1"}
Sep 06 01:09:13.428119 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.428071    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x2ncr" event={"ID":"c383b96c-cd06-45ed-aa0b-706980aae17c","Type":"ContainerStarted","Data":"1c7d214af8db760db567d9dc5ed3fbf927ab72f90244b43745e5fbffa6416b24"}
Sep 06 01:09:13.429700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.429679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt" event={"ID":"2eca0e58-9b14-4b3e-a76b-20bdfee94f69","Type":"ContainerStarted","Data":"362d796f37daa11bde9b509fdd9b764ac82542fa31f7a0311431ad7c0a281516"}
Sep 06 01:09:13.431120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.431070    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fllzt" event={"ID":"1db28da3-52e9-4c48-ac0b-69c584f20b36","Type":"ContainerStarted","Data":"e81c9640675d039afd01c1d1d2401aaadb1e57ebdcfa85694be3ab7a28d6d0fa"}
Sep 06 01:09:13.434677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.434651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal" event={"ID":"8a70fe34e4a8c25c4ae59d68c20a213c","Type":"ContainerStarted","Data":"b32b2975b3a9241fb7fc7b8f23c8614839fc71b615ab67905d55ae30295b9265"}
Sep 06 01:09:13.436030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.435998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-58rzj" event={"ID":"807d79e3-0a4f-4f9a-b15c-8732a0dc08fe","Type":"ContainerStarted","Data":"6649817374f1f9d438abedf821d50aa4f17f70ceaff6a8d22455a07929720561"}
Sep 06 01:09:13.437586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.437566    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v8dvq" event={"ID":"f9e677ae-0f91-4874-9b42-24335811139d","Type":"ContainerStarted","Data":"9c470caafdd09f0972541c6b6f9ae08815e70dbdb313ecbb5c78a1ac90eae46d"}
Sep 06 01:09:13.440247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.440226    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"114ad9c7d843e2f9cd68d96d09afd5019d84457246c4f659e0b45d5a46240f9d"}
Sep 06 01:09:13.440323 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.440278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"9920814ed46014101b9c2b4fae269717f26aca7a9dc79626b0b46bcbd7eddd6b"}
Sep 06 01:09:13.440323 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.440308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"a8afe1d5943b852a948e1d9d75ad339ca4b745b86c03af01b9974ec116fe0cd1"}
Sep 06 01:09:13.440389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.440334    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"61b26235402d708815b7d31c67b73d91c8bdb0901f6d8a300ddf6f4a73ccefc1"}
Sep 06 01:09:13.470581 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.470537    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x2ncr" podStartSLOduration=1.006733134 podStartE2EDuration="20.470522673s" totalImagesPullingTime="19.463789539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.470320236 +0000 UTC m=+21.795740208" watchObservedRunningTime="2026-09-06 01:09:13.470522673 +0000 UTC m=+21.795942646"
Sep 06 01:09:13.507374 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.507322    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-189.ec2.internal" podStartSLOduration=20.507301616 podStartE2EDuration="20.507301616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.506503834 +0000 UTC m=+21.831923812" watchObservedRunningTime="2026-09-06 01:09:13.507301616 +0000 UTC m=+21.832721594"
Sep 06 01:09:13.526857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.526812    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9prq8" podStartSLOduration=2.130071408 podStartE2EDuration="21.526796271s" totalImagesPullingTime="19.396724863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.52619415 +0000 UTC m=+21.851614128" watchObservedRunningTime="2026-09-06 01:09:13.526796271 +0000 UTC m=+21.852216249"
Sep 06 01:09:13.544954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.544914    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-58rzj" podStartSLOduration=1.24878977 podStartE2EDuration="20.544899504s" totalImagesPullingTime="19.296109734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.544486182 +0000 UTC m=+21.869906158" watchObservedRunningTime="2026-09-06 01:09:13.544899504 +0000 UTC m=+21.870319481"
Sep 06 01:09:13.567042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.567000    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fllzt" podStartSLOduration=2.215064922 podStartE2EDuration="21.566983956s" totalImagesPullingTime="19.351919034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.566553165 +0000 UTC m=+21.891973143" watchObservedRunningTime="2026-09-06 01:09:13.566983956 +0000 UTC m=+21.892403966"
Sep 06 01:09:13.602045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.601997    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v8dvq" podStartSLOduration=1.322413323 podStartE2EDuration="20.60197345s" totalImagesPullingTime="19.279560127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:13.601666735 +0000 UTC m=+21.927086737" watchObservedRunningTime="2026-09-06 01:09:13.60197345 +0000 UTC m=+21.927393427"
Sep 06 01:09:13.826384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:13.826178    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:09:14.444512 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.444480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal" event={"ID":"601a917c88665d3dd5c295b465b4861d","Type":"ContainerStarted","Data":"234cf1f3099aa747b61d02d986c03ee5fcfd7f88a7588f91ce7aa73482a1de4d"}
Sep 06 01:09:14.447465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.447431    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"685bec04cb5493f6d90ac39f45444c9d362c91ea5569cde1a25a4ac9229dbec0"}
Sep 06 01:09:14.447646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.447504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"652bd1533e0e9656915a5c1b61a2150053c57fa356fe44f47d76b214ace95ee8"}
Sep 06 01:09:14.448915 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.448876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5qp9m" event={"ID":"9304d545-69f3-43b2-8d14-8a81f2759e38","Type":"ContainerStarted","Data":"db3ae858ec9e2288c633f744bf2af4f37f7385a44a063646c357a2c306952308"}
Sep 06 01:09:14.484863 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.484807    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-189.ec2.internal" podStartSLOduration=21.484783151 podStartE2EDuration="21.484783151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:14.465934593 +0000 UTC m=+22.791354571" watchObservedRunningTime="2026-09-06 01:09:14.484783151 +0000 UTC m=+22.810203129"
Sep 06 01:09:14.485053 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.485021    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5qp9m" podStartSLOduration=2.15533481 podStartE2EDuration="21.485012814s" totalImagesPullingTime="19.329678004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:14.484185242 +0000 UTC m=+22.809605221" watchObservedRunningTime="2026-09-06 01:09:14.485012814 +0000 UTC m=+22.810432793"
Sep 06 01:09:14.671466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:14.671442    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 01:09:15.157565 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.157525    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:15.157565 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.157546    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:15.157818 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.157534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:15.157818 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:15.157668    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:15.157818 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:15.157795    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:15.157967 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:15.157860    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:15.168084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.167976    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T01:09:14.671475957Z","UUID":"da8f6f7c-eca7-46de-bc7a-4d1e855e6fa9","Handler":null,"Name":"","Endpoint":""}
Sep 06 01:09:15.169600 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.169579    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 01:09:15.169745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.169609    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 01:09:15.452779 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.452746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt" event={"ID":"2eca0e58-9b14-4b3e-a76b-20bdfee94f69","Type":"ContainerStarted","Data":"af4062e6ca3db0ede9c907868c61f4ffe050a8cce314c09a616162e789b1eba3"}
Sep 06 01:09:15.591261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.591225    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:09:15.592063 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:15.592013    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:09:16.458028 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:16.457984    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt" event={"ID":"2eca0e58-9b14-4b3e-a76b-20bdfee94f69","Type":"ContainerStarted","Data":"266663c483206f8a8c41784e33d6781414c0a96defa32b1a7e927f3f737c5c30"}
Sep 06 01:09:16.461970 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:16.461941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"70a4ff5d6eddd18acfb96b6e47d10ca0d8f2185d5ce471b20fdb91598754d896"}
Sep 06 01:09:16.462705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:16.462686    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v8dvq"
Sep 06 01:09:16.475798 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:16.475755    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gklkt" podStartSLOduration=1.561274639 podStartE2EDuration="23.475742701s" totalImagesPullingTime="21.914468062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:16.475426902 +0000 UTC m=+24.800846881" watchObservedRunningTime="2026-09-06 01:09:16.475742701 +0000 UTC m=+24.801162693"
Sep 06 01:09:17.157699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:17.157661    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:17.157699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:17.157693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:17.157939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:17.157695    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:17.157939 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:17.157792    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:17.157939 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:17.157882    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:17.158059 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:17.157939    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:18.470529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.470338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" event={"ID":"341fd325-eeff-410b-a240-056c9e523cc4","Type":"ContainerStarted","Data":"4f7d81eb75bdaba08a3f24996ae7eef544840316e6827e417cf8eb456045b7b1"}
Sep 06 01:09:18.471180 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.470581    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:18.472385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.472355    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="cfdf333744bb0af4ef492c4c1ded3648d6456018bd4fc519c5ac6987ef01285e" exitCode=0
Sep 06 01:09:18.472515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.472438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"cfdf333744bb0af4ef492c4c1ded3648d6456018bd4fc519c5ac6987ef01285e"}
Sep 06 01:09:18.486833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.486807    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:18.498864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:18.498822    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49" podStartSLOduration=6.137725991 podStartE2EDuration="25.498810032s" totalImagesPullingTime="19.361084041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:18.498313614 +0000 UTC m=+26.823733724" watchObservedRunningTime="2026-09-06 01:09:18.498810032 +0000 UTC m=+26.824230006"
Sep 06 01:09:19.156791 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.156758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:19.156791 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.156783    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:19.156976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.156786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:19.156976 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:19.156892    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:19.157042 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:19.157018    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:19.157138 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:19.157095    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:19.477179 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.477142    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="aadd9db07b82da9b21f6e8557fea7159c553966506ba6e6b693b9babb770bcf5" exitCode=0
Sep 06 01:09:19.477729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.477196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"aadd9db07b82da9b21f6e8557fea7159c553966506ba6e6b693b9babb770bcf5"}
Sep 06 01:09:19.477842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.477804    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:19.477898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.477879    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:19.493350 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:19.493325    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:20.008549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.008516    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cxwgr"]
Sep 06 01:09:20.008712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.008656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:20.008780 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:20.008749    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:20.011265 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.011236    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqv6l"]
Sep 06 01:09:20.011394 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.011327    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:20.011465 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:20.011410    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:20.014379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.014350    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n8c6k"]
Sep 06 01:09:20.014490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.014450    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:20.014564 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:20.014546    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:20.481488 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.481454    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="fdd2a0594cd79aab089447b91600c50d42dd53535c85867a400096998f8c8bbd" exitCode=0
Sep 06 01:09:20.481860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:20.481539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"fdd2a0594cd79aab089447b91600c50d42dd53535c85867a400096998f8c8bbd"}
Sep 06 01:09:21.156941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:21.156744    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:21.157081 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:21.157048    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:22.157976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:22.157944    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:22.158437 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:22.158067    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:22.158437 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:22.158073    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:22.158437 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:22.158182    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:23.156940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:23.156904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:23.157132 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:23.157049    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:24.157354 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:24.157323    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:24.157857 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.157446    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:24.157857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:24.157476    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:24.157857 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.157547    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:24.943654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:24.943616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:24.943654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:24.943660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:24.943888 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.943773    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:24.943888 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.943792    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:24.943888 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.943837    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret podName:92a27631-0fbb-4f7f-8c9f-04a5fbcb2883 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:56.943821884 +0000 UTC m=+65.269241844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret") pod "global-pull-secret-syncer-cxwgr" (UID: "92a27631-0fbb-4f7f-8c9f-04a5fbcb2883") : object "kube-system"/"original-pull-secret" not registered
Sep 06 01:09:24.943888 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:24.943854    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:09:56.943846667 +0000 UTC m=+65.269266621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 01:09:25.044837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:25.044770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:25.044960 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:25.044882    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 01:09:25.044960 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:25.044897    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 01:09:25.044960 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:25.044906    2557 projected.go:196] Error preparing data for projected volume kube-api-access-j8nj6 for pod openshift-network-diagnostics/network-check-target-sqv6l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:25.044960 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:25.044951    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6 podName:fc36a1da-e427-4978-b31c-58b90694d7d9 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:57.044939324 +0000 UTC m=+65.370359280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j8nj6" (UniqueName: "kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6") pod "network-check-target-sqv6l" (UID: "fc36a1da-e427-4978-b31c-58b90694d7d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 01:09:25.157352 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:25.157325    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:25.157528 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:25.157431    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-n8c6k" podUID="e6ec8321-c4d7-4610-95d4-77cb55f218ae"
Sep 06 01:09:25.496549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:25.496514    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="7708fcf2674247b66b9cdd98c011b2954faedab3b5d32102fef8810b4353a460" exitCode=0
Sep 06 01:09:25.496798 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:25.496567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"7708fcf2674247b66b9cdd98c011b2954faedab3b5d32102fef8810b4353a460"}
Sep 06 01:09:26.157558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.157523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:26.157919 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:26.157625    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cxwgr" podUID="92a27631-0fbb-4f7f-8c9f-04a5fbcb2883"
Sep 06 01:09:26.157919 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.157679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:26.157919 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:26.157760    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sqv6l" podUID="fc36a1da-e427-4978-b31c-58b90694d7d9"
Sep 06 01:09:26.502388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.502359    2557 generic.go:356] "Generic (PLEG): container finished" podID="be7d1fb3-d024-433a-86a3-0dd91236e5a5" containerID="31a8015ddc44f3d01bb62c32ec84480390b36e3a24f2b52b95dd984b44f87270" exitCode=0
Sep 06 01:09:26.502521 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.502405    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerDied","Data":"31a8015ddc44f3d01bb62c32ec84480390b36e3a24f2b52b95dd984b44f87270"}
Sep 06 01:09:26.979093 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.978923    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-189.ec2.internal" event="NodeReady"
Sep 06 01:09:26.979288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:26.979196    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 01:09:27.014975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.014939    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"]
Sep 06 01:09:27.038667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.038641    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"]
Sep 06 01:09:27.038821 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.038776    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.044199 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044162    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 01:09:27.044199 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044162    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 06 01:09:27.044405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044210    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 01:09:27.044405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044242    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 06 01:09:27.044405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 01:09:27.044405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044329    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 06 01:09:27.044604 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.044515    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 06 01:09:27.052774 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.052752    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"]
Sep 06 01:09:27.052897 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.052861    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.055435 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.055419    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gln8w\""
Sep 06 01:09:27.056071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.056055    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 06 01:09:27.066711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.066692    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:09:27.066814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.066799    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.069273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.069256    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 06 01:09:27.088944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.088927    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8wxkt"]
Sep 06 01:09:27.089057 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.089042    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.091522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.091505    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 01:09:27.091684 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.091667    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 01:09:27.091771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.091749    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 01:09:27.091882 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.091795    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x5q52\""
Sep 06 01:09:27.098220 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.098202    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 01:09:27.111031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111012    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"]
Sep 06 01:09:27.111113 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111035    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"]
Sep 06 01:09:27.111113 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111054    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"]
Sep 06 01:09:27.111186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111133    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:09:27.111186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111141    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.111186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.111159    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v29hk"]
Sep 06 01:09:27.113581 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.113566    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 01:09:27.113651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.113570    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 01:09:27.113651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.113631    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjq89\""
Sep 06 01:09:27.135158 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.135137    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wxkt"]
Sep 06 01:09:27.135272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.135170    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v29hk"]
Sep 06 01:09:27.135272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.135246    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.137720 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.137703    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 01:09:27.137869 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.137858    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 01:09:27.138097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.138072    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 01:09:27.138206 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.138171    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g5vzv\""
Sep 06 01:09:27.157337 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157313    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:27.157790 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093205b2-d486-4b2e-b041-6095660ad366-tmp\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157811    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdk7d\" (UniqueName: \"kubernetes.io/projected/093205b2-d486-4b2e-b041-6095660ad366-kube-api-access-mdk7d\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157899    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsk8m\" (UniqueName: \"kubernetes.io/projected/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-kube-api-access-bsk8m\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157964    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.157990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/093205b2-d486-4b2e-b041-6095660ad366-klusterlet-config\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.158059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.158025    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/596b83d7-9cd4-4386-9f44-843d755a4fb7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.158397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.158068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.158397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.158089    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.158397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.158123    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrhl2\" (UniqueName: \"kubernetes.io/projected/596b83d7-9cd4-4386-9f44-843d755a4fb7-kube-api-access-qrhl2\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.160142 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.160119    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:09:27.160321 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.160301    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:09:27.190077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.190048    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:27.258701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qtv5\" (UniqueName: \"kubernetes.io/projected/87019f13-effe-48c5-8cc0-f424391f4798-kube-api-access-4qtv5\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.258701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.258701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g68w\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrhl2\" (UniqueName: \"kubernetes.io/projected/596b83d7-9cd4-4386-9f44-843d755a4fb7-kube-api-access-qrhl2\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258807    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-cert\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.258961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87019f13-effe-48c5-8cc0-f424391f4798-tmp-dir\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093205b2-d486-4b2e-b041-6095660ad366-tmp\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.258994    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259027    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdk7d\" (UniqueName: \"kubernetes.io/projected/093205b2-d486-4b2e-b041-6095660ad366-kube-api-access-mdk7d\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259079    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259132    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsk8m\" (UniqueName: \"kubernetes.io/projected/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-kube-api-access-bsk8m\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259254    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.259292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259282    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/093205b2-d486-4b2e-b041-6095660ad366-klusterlet-config\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.259751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259305    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87019f13-effe-48c5-8cc0-f424391f4798-config-volume\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.259751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259338    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/596b83d7-9cd4-4386-9f44-843d755a4fb7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.259751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259362    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.259751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsvr7\" (UniqueName: \"kubernetes.io/projected/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-kube-api-access-dsvr7\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.259751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.259397    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/093205b2-d486-4b2e-b041-6095660ad366-tmp\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.260178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.260151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/596b83d7-9cd4-4386-9f44-843d755a4fb7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.262975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.262950    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-ca\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.263083 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.262963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.263236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.263215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/093205b2-d486-4b2e-b041-6095660ad366-klusterlet-config\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.263297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.263215    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.263297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.263218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/596b83d7-9cd4-4386-9f44-843d755a4fb7-hub\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.263297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.263262    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.266865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.266839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrhl2\" (UniqueName: \"kubernetes.io/projected/596b83d7-9cd4-4386-9f44-843d755a4fb7-kube-api-access-qrhl2\") pod \"cluster-proxy-proxy-agent-7d54db857b-w7cqk\" (UID: \"596b83d7-9cd4-4386-9f44-843d755a4fb7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.267696 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.267680    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsk8m\" (UniqueName: \"kubernetes.io/projected/6ae1ffaf-3128-44f6-8a09-e8b79ed04f51-kube-api-access-bsk8m\") pod \"managed-serviceaccount-addon-agent-86bb65689d-6mtr5\" (UID: \"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.268027 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.268010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdk7d\" (UniqueName: \"kubernetes.io/projected/093205b2-d486-4b2e-b041-6095660ad366-kube-api-access-mdk7d\") pod \"klusterlet-addon-workmgr-dbfc9d4dc-7vssn\" (UID: \"093205b2-d486-4b2e-b041-6095660ad366\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.276190 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.276162    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:27.360296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360260    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87019f13-effe-48c5-8cc0-f424391f4798-config-volume\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.360296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360523 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360320    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsvr7\" (UniqueName: \"kubernetes.io/projected/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-kube-api-access-dsvr7\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.360523 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360455    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qtv5\" (UniqueName: \"kubernetes.io/projected/87019f13-effe-48c5-8cc0-f424391f4798-kube-api-access-4qtv5\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.360523 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360523 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g68w\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360533    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.360721 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.360626    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:27.360721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-cert\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.360721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360721 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.360696    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:27.860678098 +0000 UTC m=+36.186098052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:27.360978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360833    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87019f13-effe-48c5-8cc0-f424391f4798-tmp-dir\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.360978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.360978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87019f13-effe-48c5-8cc0-f424391f4798-config-volume\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.360983    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.361007    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.360911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.361089    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:27.861054666 +0000 UTC m=+36.186474635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361138    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.361204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361167    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.361543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361243    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87019f13-effe-48c5-8cc0-f424391f4798-tmp-dir\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.361726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.361962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.361942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.363092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.363070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.363227 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.363211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-cert\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.363287 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.363242    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.368442 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.368417    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"
Sep 06 01:09:27.368987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.368964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qtv5\" (UniqueName: \"kubernetes.io/projected/87019f13-effe-48c5-8cc0-f424391f4798-kube-api-access-4qtv5\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.369462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.369442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g68w\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.369537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.369459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsvr7\" (UniqueName: \"kubernetes.io/projected/e8574ac9-345d-4c0b-9dd1-2c63a36563b0-kube-api-access-dsvr7\") pod \"ingress-canary-v29hk\" (UID: \"e8574ac9-345d-4c0b-9dd1-2c63a36563b0\") " pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.369683 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.369664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.389212 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.389190    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:27.443177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.443143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v29hk"
Sep 06 01:09:27.508902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.508790    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" event={"ID":"be7d1fb3-d024-433a-86a3-0dd91236e5a5","Type":"ContainerStarted","Data":"da3fab78b8ce6c89320e4c7f477d8c8cd5b3b425d120f8f24ae09a6310172e9b"}
Sep 06 01:09:27.532863 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.532816    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gn2d8" podStartSLOduration=4.505050443 podStartE2EDuration="34.532796249s" totalImagesPullingTime="30.027745806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:27.531969147 +0000 UTC m=+35.857389124" watchObservedRunningTime="2026-09-06 01:09:27.532796249 +0000 UTC m=+35.858216225"
Sep 06 01:09:27.654308 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.654266    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:27.672068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.672043    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5"]
Sep 06 01:09:27.676448 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.676425    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"]
Sep 06 01:09:27.677292 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:27.677251    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ae1ffaf_3128_44f6_8a09_e8b79ed04f51.slice/crio-5cc7152ff897153ab14d2533e15280326b21835b8accd35ebc4c5f5126d60dc0 WatchSource:0}: Error finding container 5cc7152ff897153ab14d2533e15280326b21835b8accd35ebc4c5f5126d60dc0: Status 404 returned error can't find the container with id 5cc7152ff897153ab14d2533e15280326b21835b8accd35ebc4c5f5126d60dc0
Sep 06 01:09:27.679751 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:27.679723    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod596b83d7_9cd4_4386_9f44_843d755a4fb7.slice/crio-070260e7b40fb336ac96f8c5993d4e7740ab5609738b27ef8e5a8abacf88642a WatchSource:0}: Error finding container 070260e7b40fb336ac96f8c5993d4e7740ab5609738b27ef8e5a8abacf88642a: Status 404 returned error can't find the container with id 070260e7b40fb336ac96f8c5993d4e7740ab5609738b27ef8e5a8abacf88642a
Sep 06 01:09:27.689327 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.689304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"]
Sep 06 01:09:27.692274 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:27.692252    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093205b2_d486_4b2e_b041_6095660ad366.slice/crio-28b48f56df030bd61901aa94e36fd1488c0e39d9de0747a9cff2de3108c10831 WatchSource:0}: Error finding container 28b48f56df030bd61901aa94e36fd1488c0e39d9de0747a9cff2de3108c10831: Status 404 returned error can't find the container with id 28b48f56df030bd61901aa94e36fd1488c0e39d9de0747a9cff2de3108c10831
Sep 06 01:09:27.742741 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.742712    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v29hk"]
Sep 06 01:09:27.745604 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:27.745565    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8574ac9_345d_4c0b_9dd1_2c63a36563b0.slice/crio-44c10f9b744244d35c84f441a85007d74ebcdfee5366883b46d44b7e3879df52 WatchSource:0}: Error finding container 44c10f9b744244d35c84f441a85007d74ebcdfee5366883b46d44b7e3879df52: Status 404 returned error can't find the container with id 44c10f9b744244d35c84f441a85007d74ebcdfee5366883b46d44b7e3879df52
Sep 06 01:09:27.746306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.746270    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:27.864062 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.863980    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:27.864062 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:27.864038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:27.864264 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.864153    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:27.864264 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.864159    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:27.864264 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.864226    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:28.864207173 +0000 UTC m=+37.189627149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:27.864264 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.864165    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:27.864391 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:27.864269    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:28.864262534 +0000 UTC m=+37.189682489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:28.145544 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.145448    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:28.157331 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.157312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:28.157544 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.157520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:28.160708 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.160692    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:09:28.161298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.160769    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 01:09:28.161298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.160906    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 01:09:28.161298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.161202    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:09:28.245725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.245696    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log" limit=1024
Sep 06 01:09:28.514637 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.514599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn" event={"ID":"093205b2-d486-4b2e-b041-6095660ad366","Type":"ContainerStarted","Data":"28b48f56df030bd61901aa94e36fd1488c0e39d9de0747a9cff2de3108c10831"}
Sep 06 01:09:28.517755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.517694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v29hk" event={"ID":"e8574ac9-345d-4c0b-9dd1-2c63a36563b0","Type":"ContainerStarted","Data":"44c10f9b744244d35c84f441a85007d74ebcdfee5366883b46d44b7e3879df52"}
Sep 06 01:09:28.520212 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.520144    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5" event={"ID":"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51","Type":"ContainerStarted","Data":"5cc7152ff897153ab14d2533e15280326b21835b8accd35ebc4c5f5126d60dc0"}
Sep 06 01:09:28.522958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.522908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerStarted","Data":"070260e7b40fb336ac96f8c5993d4e7740ab5609738b27ef8e5a8abacf88642a"}
Sep 06 01:09:28.873500 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.873183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:28.873651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:28.873497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:28.873717 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:28.873358    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:28.873772 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:28.873746    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:30.87372714 +0000 UTC m=+39.199147099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:28.874094 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:28.873680    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:28.874206 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:28.874096    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:28.874372 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:28.874204    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:30.874143902 +0000 UTC m=+39.199563877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:30.893491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:30.893443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:30.893547    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:30.893677    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:30.893699    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:30.893762    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:34.893742338 +0000 UTC m=+43.219162313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:30.893682    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:30.894010 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:30.893828    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:34.893816704 +0000 UTC m=+43.219236674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:34.924626 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:34.924588    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:34.924676    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:34.924764    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:34.924821    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:34.924836    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:34.924843    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:42.92482093 +0000 UTC m=+51.250240885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:34.925123 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:34.924887    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:42.924870055 +0000 UTC m=+51.250290011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:36.550472 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.550436    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn" event={"ID":"093205b2-d486-4b2e-b041-6095660ad366","Type":"ContainerStarted","Data":"0a24493e2fd298454acdf6a551668c9f2bcc4bca78d336f198a277aedb93aecc"}
Sep 06 01:09:36.550925 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.550533    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:36.552219 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.552195    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn"
Sep 06 01:09:36.552325 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.552242    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v29hk" event={"ID":"e8574ac9-345d-4c0b-9dd1-2c63a36563b0","Type":"ContainerStarted","Data":"9fe954b55a893226740b089afa08703653df5d42624535267cbdc581516ea15d"}
Sep 06 01:09:36.553860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.553838    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5" event={"ID":"6ae1ffaf-3128-44f6-8a09-e8b79ed04f51","Type":"ContainerStarted","Data":"dc40db40fed920d3de2491ee2f8978fd3b419daa19c6c2bfcafeac464d33408e"}
Sep 06 01:09:36.555841 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.555821    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerStarted","Data":"4dbc557118b7d1dd68f182e4dc0abdd136dd1110727838e724498be91017a026"}
Sep 06 01:09:36.555936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.555852    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerStarted","Data":"e75d3f779e3e8276f379e95d30b01be0fd324593e6b6976c1cc00b3240293d62"}
Sep 06 01:09:36.571018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.570971    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-dbfc9d4dc-7vssn" podStartSLOduration=19.045034757 podStartE2EDuration="27.570953388s" totalImagesPullingTime="8.525918631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:36.570610177 +0000 UTC m=+44.896030153" watchObservedRunningTime="2026-09-06 01:09:36.570953388 +0000 UTC m=+44.896373366"
Sep 06 01:09:36.601718 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.601661    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86bb65689d-6mtr5" podStartSLOduration=19.061257129 podStartE2EDuration="27.601644861s" totalImagesPullingTime="8.540387732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:36.601170136 +0000 UTC m=+44.926590116" watchObservedRunningTime="2026-09-06 01:09:36.601644861 +0000 UTC m=+44.927064832"
Sep 06 01:09:36.618207 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.618154    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v29hk" podStartSLOduration=1.145523858 podStartE2EDuration="9.618138758s" totalImagesPullingTime="8.4726149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:36.617510251 +0000 UTC m=+44.942930230" watchObservedRunningTime="2026-09-06 01:09:36.618138758 +0000 UTC m=+44.943558732"
Sep 06 01:09:36.886758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.886674    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-vccww"]
Sep 06 01:09:36.911547 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.911521    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-vccww"]
Sep 06 01:09:36.911714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.911624    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:36.914491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.914464    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 06 01:09:36.914605 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.914545    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 01:09:36.914644 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.914476    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 06 01:09:36.914644 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.914470    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p7db8\""
Sep 06 01:09:36.914732 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.914545    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 01:09:36.920045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.920025    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 06 01:09:36.989445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.989417    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"]
Sep 06 01:09:36.999992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:36.999966    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"]
Sep 06 01:09:37.000135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.000078    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"
Sep 06 01:09:37.003153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.003129    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.003153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.003147    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.003328 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.003173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-75mx2\""
Sep 06 01:09:37.016012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.015989    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"]
Sep 06 01:09:37.016162 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.016144    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.019257 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.019220    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 06 01:09:37.019362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.019281    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6dg58\""
Sep 06 01:09:37.019439 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.019418    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 06 01:09:37.019498 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.019440    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.019748 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.019731    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.030127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.030091    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-qvj9n"]
Sep 06 01:09:37.030245 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.030147    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.032706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.032687    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 06 01:09:37.032811 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.032744    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.032811 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.032742    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zpmq2\""
Sep 06 01:09:37.034377 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.034360    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 06 01:09:37.034439 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.034363    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.041341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041321    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-snapshots\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.041433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-serving-cert\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.041433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041373    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.041433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.041557 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041438    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfw2k\" (UniqueName: \"kubernetes.io/projected/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-kube-api-access-zfw2k\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.041557 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.041455    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-tmp\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.046223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.046202    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f886f478-psnfb"]
Sep 06 01:09:37.046324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.046310    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.048698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.048675    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 06 01:09:37.048836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.048819    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.048937 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.048921    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.048984 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.048951    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 06 01:09:37.049028 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.048981    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wgx9f\""
Sep 06 01:09:37.053407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.053388    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 06 01:09:37.064773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064753    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"]
Sep 06 01:09:37.064853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"]
Sep 06 01:09:37.064853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064795    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-qvj9n"]
Sep 06 01:09:37.064853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064812    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f886f478-psnfb"]
Sep 06 01:09:37.064853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"]
Sep 06 01:09:37.064973 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.064857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.067060 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067041    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kjjg8\""
Sep 06 01:09:37.067273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067254    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 06 01:09:37.067273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067264    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 06 01:09:37.067434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067281    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.067434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067355    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 06 01:09:37.067434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067395    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.067659 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.067644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 06 01:09:37.085665 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.085647    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"]
Sep 06 01:09:37.092935 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.092917    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"]
Sep 06 01:09:37.093045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.093028    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.095333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.095315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 06 01:09:37.095333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.095327    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5rkqm\""
Sep 06 01:09:37.095436 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.095332    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.095910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.095894    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.100861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.100841    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"]
Sep 06 01:09:37.100955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.100928    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.102214 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.102193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"]
Sep 06 01:09:37.103205 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.103173    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 06 01:09:37.103297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.103189    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 06 01:09:37.103589 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.103571    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 06 01:09:37.103674 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.103614    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9vgxb\""
Sep 06 01:09:37.103731 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.103571    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 06 01:09:37.142310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142251    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-serving-cert\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29sbd\" (UniqueName: \"kubernetes.io/projected/6cac5cf6-00a3-4393-ad08-a1a776defc04-kube-api-access-29sbd\") pod \"volume-data-source-validator-695c895bd6-lvh7b\" (UID: \"6cac5cf6-00a3-4393-ad08-a1a776defc04\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"
Sep 06 01:09:37.142310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142304    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df628eb-2a55-444f-b92f-5d5b140bcf7f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.142487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142323    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142341    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-config\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.142487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142420    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142460    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfw2k\" (UniqueName: \"kubernetes.io/projected/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-kube-api-access-zfw2k\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142491    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-tmp\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa511636-24ee-41a0-b205-3e30836edf53-serving-cert\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.142645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8v5\" (UniqueName: \"kubernetes.io/projected/aa511636-24ee-41a0-b205-3e30836edf53-kube-api-access-sn8v5\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.142645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th45z\" (UniqueName: \"kubernetes.io/projected/188873e6-b47d-4de0-8130-23dead3b720d-kube-api-access-th45z\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.142837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2df628eb-2a55-444f-b92f-5d5b140bcf7f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.142837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-snapshots\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.142837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142746    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.142837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142780    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2lp\" (UniqueName: \"kubernetes.io/projected/2df628eb-2a55-444f-b92f-5d5b140bcf7f-kube-api-access-2k2lp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.143130 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.142810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-trusted-ca\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.143341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.143320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/188873e6-b47d-4de0-8130-23dead3b720d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.143439 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.143415    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-tmp\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.143687 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.143665    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.143896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.143876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-snapshots\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.144222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.144196    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.147293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.145978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-serving-cert\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.153170 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.153145    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfw2k\" (UniqueName: \"kubernetes.io/projected/6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10-kube-api-access-zfw2k\") pod \"insights-operator-76bcd6ccf5-vccww\" (UID: \"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10\") " pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.220196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.220168    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww"
Sep 06 01:09:37.243823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.243799    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/188873e6-b47d-4de0-8130-23dead3b720d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.243934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.243836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29sbd\" (UniqueName: \"kubernetes.io/projected/6cac5cf6-00a3-4393-ad08-a1a776defc04-kube-api-access-29sbd\") pod \"volume-data-source-validator-695c895bd6-lvh7b\" (UID: \"6cac5cf6-00a3-4393-ad08-a1a776defc04\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"
Sep 06 01:09:37.243934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.243857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df628eb-2a55-444f-b92f-5d5b140bcf7f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.244084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.243968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-config\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.244084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.244084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa511636-24ee-41a0-b205-3e30836edf53-serving-cert\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.244248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.244248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244159    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76p4\" (UniqueName: \"kubernetes.io/projected/41ffc608-485d-4522-8172-7a0daefa67b2-kube-api-access-w76p4\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.244248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsnw6\" (UniqueName: \"kubernetes.io/projected/763f5406-4161-402e-9e84-aac660057b77-kube-api-access-fsnw6\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.244248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244218    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8v5\" (UniqueName: \"kubernetes.io/projected/aa511636-24ee-41a0-b205-3e30836edf53-kube-api-access-sn8v5\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.244447 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th45z\" (UniqueName: \"kubernetes.io/projected/188873e6-b47d-4de0-8130-23dead3b720d-kube-api-access-th45z\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.244447 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-default-certificate\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.244541 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.244600 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244540    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-stats-auth\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.244649 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2df628eb-2a55-444f-b92f-5d5b140bcf7f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.244707 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244692    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/188873e6-b47d-4de0-8130-23dead3b720d-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.244761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-config\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.244761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8bpv\" (UniqueName: \"kubernetes.io/projected/dba8747c-e652-4685-804a-276d52281982-kube-api-access-q8bpv\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.244861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41ffc608-485d-4522-8172-7a0daefa67b2-config\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.244861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.244861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2lp\" (UniqueName: \"kubernetes.io/projected/2df628eb-2a55-444f-b92f-5d5b140bcf7f-kube-api-access-2k2lp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.245004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244885    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ffc608-485d-4522-8172-7a0daefa67b2-serving-cert\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.245004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.244905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-trusted-ca\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.245137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.245096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2df628eb-2a55-444f-b92f-5d5b140bcf7f-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.245271 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.245254    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:37.245389 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.245341    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:09:37.745321726 +0000 UTC m=+46.070741687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:37.245855 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.245833    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa511636-24ee-41a0-b205-3e30836edf53-trusted-ca\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.246812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.246792    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa511636-24ee-41a0-b205-3e30836edf53-serving-cert\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.247063 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.247047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df628eb-2a55-444f-b92f-5d5b140bcf7f-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.255815 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.255786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2lp\" (UniqueName: \"kubernetes.io/projected/2df628eb-2a55-444f-b92f-5d5b140bcf7f-kube-api-access-2k2lp\") pod \"kube-storage-version-migrator-operator-8d7dd4675-tnqwd\" (UID: \"2df628eb-2a55-444f-b92f-5d5b140bcf7f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.256545 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.256519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8v5\" (UniqueName: \"kubernetes.io/projected/aa511636-24ee-41a0-b205-3e30836edf53-kube-api-access-sn8v5\") pod \"console-operator-85b454874b-qvj9n\" (UID: \"aa511636-24ee-41a0-b205-3e30836edf53\") " pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.256545 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.256537    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th45z\" (UniqueName: \"kubernetes.io/projected/188873e6-b47d-4de0-8130-23dead3b720d-kube-api-access-th45z\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.256718 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.256636    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29sbd\" (UniqueName: \"kubernetes.io/projected/6cac5cf6-00a3-4393-ad08-a1a776defc04-kube-api-access-29sbd\") pod \"volume-data-source-validator-695c895bd6-lvh7b\" (UID: \"6cac5cf6-00a3-4393-ad08-a1a776defc04\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"
Sep 06 01:09:37.315635 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.315607    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"
Sep 06 01:09:37.326903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.326880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"
Sep 06 01:09:37.345358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76p4\" (UniqueName: \"kubernetes.io/projected/41ffc608-485d-4522-8172-7a0daefa67b2-kube-api-access-w76p4\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.345427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsnw6\" (UniqueName: \"kubernetes.io/projected/763f5406-4161-402e-9e84-aac660057b77-kube-api-access-fsnw6\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.345427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-default-certificate\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.345491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345440    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.345534 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.345511    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 01:09:37.345575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-stats-auth\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.345575 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.345563    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls podName:763f5406-4161-402e-9e84-aac660057b77 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:37.84554615 +0000 UTC m=+46.170966105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fqbp8" (UID: "763f5406-4161-402e-9e84-aac660057b77") : secret "samples-operator-tls" not found
Sep 06 01:09:37.345679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8bpv\" (UniqueName: \"kubernetes.io/projected/dba8747c-e652-4685-804a-276d52281982-kube-api-access-q8bpv\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.345679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41ffc608-485d-4522-8172-7a0daefa67b2-config\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.345679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ffc608-485d-4522-8172-7a0daefa67b2-serving-cert\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.345820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345730    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.345820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.345764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.345920 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.345864    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:37.345920 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.345897    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:37.845880914 +0000 UTC m=+46.171300891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:37.346036 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.345939    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:37.845922133 +0000 UTC m=+46.171342098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:37.346170 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.346150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41ffc608-485d-4522-8172-7a0daefa67b2-config\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.347955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.347937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41ffc608-485d-4522-8172-7a0daefa67b2-serving-cert\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.348035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.347960    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-stats-auth\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.348386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.348365    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-default-certificate\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.355165 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.355146    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:37.360457 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.360436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76p4\" (UniqueName: \"kubernetes.io/projected/41ffc608-485d-4522-8172-7a0daefa67b2-kube-api-access-w76p4\") pod \"service-ca-operator-859f94c4b-frfb6\" (UID: \"41ffc608-485d-4522-8172-7a0daefa67b2\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.360670 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.360651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8bpv\" (UniqueName: \"kubernetes.io/projected/dba8747c-e652-4685-804a-276d52281982-kube-api-access-q8bpv\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.360750 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.360728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsnw6\" (UniqueName: \"kubernetes.io/projected/763f5406-4161-402e-9e84-aac660057b77-kube-api-access-fsnw6\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.410166 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.410078    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"
Sep 06 01:09:37.513524 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.513403    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-vccww"]
Sep 06 01:09:37.519910 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:37.519796    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b69ed93_1b38_4d10_b62b_ba1cdd4a1a10.slice/crio-e0f6b8efd60a8c0952af09b1c5bdf856025b0b094a2e2743fe283e37af0f455d WatchSource:0}: Error finding container e0f6b8efd60a8c0952af09b1c5bdf856025b0b094a2e2743fe283e37af0f455d: Status 404 returned error can't find the container with id e0f6b8efd60a8c0952af09b1c5bdf856025b0b094a2e2743fe283e37af0f455d
Sep 06 01:09:37.560840 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.560804    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerStarted","Data":"1b359cc44dc4e82bc6340b82f0f02d91e17bc7b297d506db6108b88dc439d155"}
Sep 06 01:09:37.562125 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.562086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww" event={"ID":"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10","Type":"ContainerStarted","Data":"e0f6b8efd60a8c0952af09b1c5bdf856025b0b094a2e2743fe283e37af0f455d"}
Sep 06 01:09:37.585935 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.585894    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" podStartSLOduration=20.032549115 podStartE2EDuration="28.585879269s" totalImagesPullingTime="8.553330154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:37.585475478 +0000 UTC m=+45.910895466" watchObservedRunningTime="2026-09-06 01:09:37.585879269 +0000 UTC m=+45.911299245"
Sep 06 01:09:37.610035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.610010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b"]
Sep 06 01:09:37.612729 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:37.612707    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cac5cf6_00a3_4393_ad08_a1a776defc04.slice/crio-6ab32d604bf02cf606aa69e4e30a7db84ab84e95335c1fb06195619474e66b1e WatchSource:0}: Error finding container 6ab32d604bf02cf606aa69e4e30a7db84ab84e95335c1fb06195619474e66b1e: Status 404 returned error can't find the container with id 6ab32d604bf02cf606aa69e4e30a7db84ab84e95335c1fb06195619474e66b1e
Sep 06 01:09:37.660185 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.660120    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd"]
Sep 06 01:09:37.662483 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:37.662457    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df628eb_2a55_444f_b92f_5d5b140bcf7f.slice/crio-a13387ba3e59e849add484ae82f8a0e771ef226d9654756381d16f749eaa2b64 WatchSource:0}: Error finding container a13387ba3e59e849add484ae82f8a0e771ef226d9654756381d16f749eaa2b64: Status 404 returned error can't find the container with id a13387ba3e59e849add484ae82f8a0e771ef226d9654756381d16f749eaa2b64
Sep 06 01:09:37.692066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.692043    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-qvj9n"]
Sep 06 01:09:37.694486 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:37.694463    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa511636_24ee_41a0_b205_3e30836edf53.slice/crio-04cdebc615e65babf14f6717218d11d3fdf54469ddf2857808b6fc2941b3b3ba WatchSource:0}: Error finding container 04cdebc615e65babf14f6717218d11d3fdf54469ddf2857808b6fc2941b3b3ba: Status 404 returned error can't find the container with id 04cdebc615e65babf14f6717218d11d3fdf54469ddf2857808b6fc2941b3b3ba
Sep 06 01:09:37.731042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.731021    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6"]
Sep 06 01:09:37.733655 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:37.733635    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ffc608_485d_4522_8172_7a0daefa67b2.slice/crio-fd0a0b43829849563fd1566d431d6f6b0e74d30297b9d0ac22d737e226b2fc07 WatchSource:0}: Error finding container fd0a0b43829849563fd1566d431d6f6b0e74d30297b9d0ac22d737e226b2fc07: Status 404 returned error can't find the container with id fd0a0b43829849563fd1566d431d6f6b0e74d30297b9d0ac22d737e226b2fc07
Sep 06 01:09:37.750221 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.750192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:37.750398 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.750379    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:37.750482 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.750460    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:09:38.750439384 +0000 UTC m=+47.075859347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:37.851144 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.851087    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.851162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.851201    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:37.851225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.851259    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:38.85124488 +0000 UTC m=+47.176664835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.851305    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 01:09:37.851334 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.851324    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:38.851308498 +0000 UTC m=+47.176728473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:37.851538 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:37.851348    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls podName:763f5406-4161-402e-9e84-aac660057b77 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:38.851337866 +0000 UTC m=+47.176757839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fqbp8" (UID: "763f5406-4161-402e-9e84-aac660057b77") : secret "samples-operator-tls" not found
Sep 06 01:09:38.567291 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.567254    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6" event={"ID":"41ffc608-485d-4522-8172-7a0daefa67b2","Type":"ContainerStarted","Data":"fd0a0b43829849563fd1566d431d6f6b0e74d30297b9d0ac22d737e226b2fc07"}
Sep 06 01:09:38.569083 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.569030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" event={"ID":"aa511636-24ee-41a0-b205-3e30836edf53","Type":"ContainerStarted","Data":"04cdebc615e65babf14f6717218d11d3fdf54469ddf2857808b6fc2941b3b3ba"}
Sep 06 01:09:38.571225 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.571180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd" event={"ID":"2df628eb-2a55-444f-b92f-5d5b140bcf7f","Type":"ContainerStarted","Data":"a13387ba3e59e849add484ae82f8a0e771ef226d9654756381d16f749eaa2b64"}
Sep 06 01:09:38.572677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.572614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b" event={"ID":"6cac5cf6-00a3-4393-ad08-a1a776defc04","Type":"ContainerStarted","Data":"6ab32d604bf02cf606aa69e4e30a7db84ab84e95335c1fb06195619474e66b1e"}
Sep 06 01:09:38.762832 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.762791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:38.764041 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.763394    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:38.764041 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.763471    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.763450481 +0000 UTC m=+49.088870441 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:38.864360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.864278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:38.864360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.864330    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:38.864619 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:38.864409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:38.864619 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.864583    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 01:09:38.864800 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.864649    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls podName:763f5406-4161-402e-9e84-aac660057b77 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.86463209 +0000 UTC m=+49.190052047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fqbp8" (UID: "763f5406-4161-402e-9e84-aac660057b77") : secret "samples-operator-tls" not found
Sep 06 01:09:38.865081 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.865062    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:38.865195 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.865131    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.865116198 +0000 UTC m=+49.190536181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:38.865261 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:38.865203    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:40.865191828 +0000 UTC m=+49.190611798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:40.779610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:40.779570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:40.779969 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.779722    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:40.779969 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.779790    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.779775213 +0000 UTC m=+53.105195171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:40.880385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:40.880347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:40.880540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:40.880393    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:40.880540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:40.880467    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:40.880540 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.880489    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:40.880705 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.880549    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.880534011 +0000 UTC m=+53.205953967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:40.880705 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.880569    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.880555484 +0000 UTC m=+53.205975439 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:40.880705 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.880583    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 01:09:40.880705 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:40.880637    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls podName:763f5406-4161-402e-9e84-aac660057b77 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.880622916 +0000 UTC m=+53.206042872 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fqbp8" (UID: "763f5406-4161-402e-9e84-aac660057b77") : secret "samples-operator-tls" not found
Sep 06 01:09:42.591665 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:42.591614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww" event={"ID":"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10","Type":"ContainerStarted","Data":"9908d2e22f3a4f34bd3c3af193d00352d3dadb1093620093f2bf9158cc561561"}
Sep 06 01:09:42.593832 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:42.593793    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b" event={"ID":"6cac5cf6-00a3-4393-ad08-a1a776defc04","Type":"ContainerStarted","Data":"3f7a4302631fadf052f6a516b4cee78dd59961c3722b250622f037c3851009a3"}
Sep 06 01:09:43.002097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.002059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:43.002248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.002188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:43.002248 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.002217    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 01:09:43.002248 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.002237    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-786c879bb4-9pbc8: secret "image-registry-tls" not found
Sep 06 01:09:43.002352 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.002299    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls podName:7b31e904-433b-4a10-95f2-d5cc9759bc20 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.002283224 +0000 UTC m=+67.327703199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls") pod "image-registry-786c879bb4-9pbc8" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20") : secret "image-registry-tls" not found
Sep 06 01:09:43.002352 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.002338    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 01:09:43.002420 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.002402    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls podName:87019f13-effe-48c5-8cc0-f424391f4798 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.00238604 +0000 UTC m=+67.327806001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls") pod "dns-default-8wxkt" (UID: "87019f13-effe-48c5-8cc0-f424391f4798") : secret "dns-default-metrics-tls" not found
Sep 06 01:09:43.598793 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.598762    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/0.log"
Sep 06 01:09:43.599203 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.598813    2557 generic.go:356] "Generic (PLEG): container finished" podID="aa511636-24ee-41a0-b205-3e30836edf53" containerID="efed7471a9abb04691f043e2617b039e030341b29c8bd7b066216dd26fb1cd35" exitCode=255
Sep 06 01:09:43.599203 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.598902    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" event={"ID":"aa511636-24ee-41a0-b205-3e30836edf53","Type":"ContainerDied","Data":"efed7471a9abb04691f043e2617b039e030341b29c8bd7b066216dd26fb1cd35"}
Sep 06 01:09:43.599203 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.599090    2557 scope.go:117] "RemoveContainer" containerID="efed7471a9abb04691f043e2617b039e030341b29c8bd7b066216dd26fb1cd35"
Sep 06 01:09:43.600638 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.600611    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd" event={"ID":"2df628eb-2a55-444f-b92f-5d5b140bcf7f","Type":"ContainerStarted","Data":"493465e4b64d311d6ccf0a1f28118126994ff02150ff1dd4606e2b680a6532c5"}
Sep 06 01:09:43.602320 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.602294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6" event={"ID":"41ffc608-485d-4522-8172-7a0daefa67b2","Type":"ContainerStarted","Data":"92473a2a84814cf7e20a7fc498f300acfcd6690ebbf763627c902c081b252f22"}
Sep 06 01:09:43.643694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.643097    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd" podStartSLOduration=2.834830374 podStartE2EDuration="7.643076412s" totalImagesPullingTime="4.808246038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:43.642511468 +0000 UTC m=+51.967931446" watchObservedRunningTime="2026-09-06 01:09:43.643076412 +0000 UTC m=+51.968496390"
Sep 06 01:09:43.671773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.671725    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6" podStartSLOduration=1.930156405 podStartE2EDuration="6.671707994s" totalImagesPullingTime="4.741551589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:43.670492196 +0000 UTC m=+51.995912177" watchObservedRunningTime="2026-09-06 01:09:43.671707994 +0000 UTC m=+51.997127972"
Sep 06 01:09:43.693967 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.693905    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww" podStartSLOduration=2.743385759 podStartE2EDuration="7.693870956s" totalImagesPullingTime="4.950485197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:43.69258855 +0000 UTC m=+52.018008529" watchObservedRunningTime="2026-09-06 01:09:43.693870956 +0000 UTC m=+52.019290933"
Sep 06 01:09:43.717495 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.717278    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-lvh7b" podStartSLOduration=2.85967448 podStartE2EDuration="7.717256145s" totalImagesPullingTime="4.857581665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:43.716968675 +0000 UTC m=+52.042388654" watchObservedRunningTime="2026-09-06 01:09:43.717256145 +0000 UTC m=+52.042676189"
Sep 06 01:09:43.741026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.740989    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pmw75"]
Sep 06 01:09:43.744953 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.744923    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.747637 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.747612    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 01:09:43.747795 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.747773    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5j6d7\""
Sep 06 01:09:43.748121 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.748088    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 01:09:43.756572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.756523    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pmw75"]
Sep 06 01:09:43.816214 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.816181    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.816343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.816229    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkfxl\" (UniqueName: \"kubernetes.io/projected/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-api-access-nkfxl\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.816343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.816274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96c0717b-654b-4af2-9bfd-857f473cf2be-crio-socket\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.816343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.816312    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96c0717b-654b-4af2-9bfd-857f473cf2be-data-volume\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.816512 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.816402    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917525 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917652    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkfxl\" (UniqueName: \"kubernetes.io/projected/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-api-access-nkfxl\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917737 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.917663    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:43.917737 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917692    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96c0717b-654b-4af2-9bfd-857f473cf2be-crio-socket\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917737 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.917725    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.417706369 +0000 UTC m=+52.743126347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:43.917934 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.917729    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:43.917934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917752    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96c0717b-654b-4af2-9bfd-857f473cf2be-data-volume\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.917934 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:43.917789    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:44.417772007 +0000 UTC m=+52.743191979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:43.917934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.917858    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/96c0717b-654b-4af2-9bfd-857f473cf2be-crio-socket\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.918154 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.918028    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/96c0717b-654b-4af2-9bfd-857f473cf2be-data-volume\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:43.926791 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:43.926767    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkfxl\" (UniqueName: \"kubernetes.io/projected/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-api-access-nkfxl\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:44.422715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.422675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:44.422892 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.422796    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.422892 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.422854    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:45.42284039 +0000 UTC m=+53.748260350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:44.422892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.422796    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:44.422892 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.422885    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.423135 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.422955    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:45.42293756 +0000 UTC m=+53.748357519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:44.608271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.608241    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:09:44.608725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.608706    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/0.log"
Sep 06 01:09:44.608790 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.608772    2557 generic.go:356] "Generic (PLEG): container finished" podID="aa511636-24ee-41a0-b205-3e30836edf53" containerID="c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6" exitCode=255
Sep 06 01:09:44.608875 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.608844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" event={"ID":"aa511636-24ee-41a0-b205-3e30836edf53","Type":"ContainerDied","Data":"c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6"}
Sep 06 01:09:44.609012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.608931    2557 scope.go:117] "RemoveContainer" containerID="efed7471a9abb04691f043e2617b039e030341b29c8bd7b066216dd26fb1cd35"
Sep 06 01:09:44.609217 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.609200    2557 scope.go:117] "RemoveContainer" containerID="c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6"
Sep 06 01:09:44.609523 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.609500    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-qvj9n_openshift-console-operator(aa511636-24ee-41a0-b205-3e30836edf53)\"" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" podUID="aa511636-24ee-41a0-b205-3e30836edf53"
Sep 06 01:09:44.826893 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.826851    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:44.827050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.826978    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:44.827050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.827040    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:09:52.82702314 +0000 UTC m=+61.152443112 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:44.927808 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.927781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:44.927957 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.927815    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:44.927957 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.927913    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:44.928035 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.927920    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:52.927906185 +0000 UTC m=+61.253326140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:44.928035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:44.928001    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:44.928035 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.928026    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:52.928004796 +0000 UTC m=+61.253424751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:44.928170 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.928068    2557 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 01:09:44.928170 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:44.928152    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls podName:763f5406-4161-402e-9e84-aac660057b77 nodeName:}" failed. No retries permitted until 2026-09-06 01:09:52.92813853 +0000 UTC m=+61.253558495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-fqbp8" (UID: "763f5406-4161-402e-9e84-aac660057b77") : secret "samples-operator-tls" not found
Sep 06 01:09:45.111180 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:45.111115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-58rzj_807d79e3-0a4f-4f9a-b15c-8732a0dc08fe/dns-node-resolver/0.log"
Sep 06 01:09:45.432465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:45.432394    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:45.432589 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:45.432483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:45.432589 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:45.432519    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:45.432589 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:45.432557    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:45.432589 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:45.432576    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:47.432561159 +0000 UTC m=+55.757981118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:45.432724 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:45.432596    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:47.432584508 +0000 UTC m=+55.758004464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:45.617751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:45.617723    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:09:45.618184 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:45.618009    2557 scope.go:117] "RemoveContainer" containerID="c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6"
Sep 06 01:09:45.618184 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:45.618163    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-qvj9n_openshift-console-operator(aa511636-24ee-41a0-b205-3e30836edf53)\"" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" podUID="aa511636-24ee-41a0-b205-3e30836edf53"
Sep 06 01:09:46.113201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:46.113172    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fllzt_1db28da3-52e9-4c48-ac0b-69c584f20b36/node-ca/0.log"
Sep 06 01:09:46.910583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:46.910554    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v29hk_e8574ac9-345d-4c0b-9dd1-2c63a36563b0/serve-healthcheck-canary/0.log"
Sep 06 01:09:47.356009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:47.355973    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:47.356181 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:47.356034    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:47.356374 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:47.356361    2557 scope.go:117] "RemoveContainer" containerID="c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6"
Sep 06 01:09:47.356518 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:47.356501    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-qvj9n_openshift-console-operator(aa511636-24ee-41a0-b205-3e30836edf53)\"" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" podUID="aa511636-24ee-41a0-b205-3e30836edf53"
Sep 06 01:09:47.450599 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:47.450567    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:47.450736 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:47.450689    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:47.450736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:47.450710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:47.450857 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:47.450750    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:51.450732053 +0000 UTC m=+59.776152027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:47.451006 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:47.450989    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:47.451085 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:47.451054    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:51.451035683 +0000 UTC m=+59.776455658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:51.484221 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:51.484164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:51.484609 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:51.484311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:51.484609 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:51.484319    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 01:09:51.484609 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:51.484402    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.484381459 +0000 UTC m=+67.809801428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : configmap "kube-rbac-proxy" not found
Sep 06 01:09:51.484609 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:51.484479    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:51.484609 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:51.484546    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:09:59.484532336 +0000 UTC m=+67.809952291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:51.494499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:51.494473    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkl49"
Sep 06 01:09:52.902441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:52.902395    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:09:52.902903 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:52.902550    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:52.902903 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:52.902621    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls podName:188873e6-b47d-4de0-8130-23dead3b720d nodeName:}" failed. No retries permitted until 2026-09-06 01:10:08.902607272 +0000 UTC m=+77.228027228 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-nzvhs" (UID: "188873e6-b47d-4de0-8130-23dead3b720d") : secret "cluster-monitoring-operator-tls" not found
Sep 06 01:09:53.002842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.002804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:53.002842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.002847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:09:53.003050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.002906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:53.003050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:53.002942    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 01:09:53.003050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:53.003014    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:09.00299428 +0000 UTC m=+77.328414253 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : configmap references non-existent config key: service-ca.crt
Sep 06 01:09:53.003050 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:53.003029    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs podName:dba8747c-e652-4685-804a-276d52281982 nodeName:}" failed. No retries permitted until 2026-09-06 01:10:09.003023438 +0000 UTC m=+77.328443393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs") pod "router-default-f886f478-psnfb" (UID: "dba8747c-e652-4685-804a-276d52281982") : secret "router-metrics-certs-default" not found
Sep 06 01:09:53.005249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.005227    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/763f5406-4161-402e-9e84-aac660057b77-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-fqbp8\" (UID: \"763f5406-4161-402e-9e84-aac660057b77\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:53.303317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.303284    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5rkqm\""
Sep 06 01:09:53.311197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.311172    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"
Sep 06 01:09:53.578213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.578135    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8"]
Sep 06 01:09:53.645280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:53.645243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8" event={"ID":"763f5406-4161-402e-9e84-aac660057b77","Type":"ContainerStarted","Data":"0e2e1007f20e382678126589db49c3f8458afad554b3ac10f82a8d8ddcceee95"}
Sep 06 01:09:55.654469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:55.654381    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8" event={"ID":"763f5406-4161-402e-9e84-aac660057b77","Type":"ContainerStarted","Data":"310c13627ab3882cdbbfeaa47a0e92cdad4b015068b6469e63bab59933446b7e"}
Sep 06 01:09:55.654469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:55.654453    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8" event={"ID":"763f5406-4161-402e-9e84-aac660057b77","Type":"ContainerStarted","Data":"3192296bdb3045533468dda31d9cf88f79447b0a4e578eefad062d372603a32c"}
Sep 06 01:09:55.670917 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:55.670874    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-fqbp8" podStartSLOduration=16.98055095 podStartE2EDuration="18.670858935s" totalImagesPullingTime="1.690307985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:55.670056149 +0000 UTC m=+63.995476127" watchObservedRunningTime="2026-09-06 01:09:55.670858935 +0000 UTC m=+63.996278911"
Sep 06 01:09:57.041522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.041481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:57.041522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.041524    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:09:57.044160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.044137    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 01:09:57.044635 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.044619    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 01:09:57.052566 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:57.052544    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 06 01:09:57.052641 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:57.052604    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs podName:e6ec8321-c4d7-4610-95d4-77cb55f218ae nodeName:}" failed. No retries permitted until 2026-09-06 01:11:01.052589805 +0000 UTC m=+129.378009761 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs") pod "network-metrics-daemon-n8c6k" (UID: "e6ec8321-c4d7-4610-95d4-77cb55f218ae") : secret "metrics-daemon-secret" not found
Sep 06 01:09:57.054619 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.054599    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/92a27631-0fbb-4f7f-8c9f-04a5fbcb2883-original-pull-secret\") pod \"global-pull-secret-syncer-cxwgr\" (UID: \"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883\") " pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:57.142614 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.142585    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:57.145501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.145482    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 01:09:57.155656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.155635    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 01:09:57.166231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.166211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8nj6\" (UniqueName: \"kubernetes.io/projected/fc36a1da-e427-4978-b31c-58b90694d7d9-kube-api-access-j8nj6\") pod \"network-check-target-sqv6l\" (UID: \"fc36a1da-e427-4978-b31c-58b90694d7d9\") " pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:57.270684 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.270652    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7gxmf\""
Sep 06 01:09:57.272633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.272616    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cxwgr"
Sep 06 01:09:57.278751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.278732    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:09:57.560880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.560855    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cxwgr"]
Sep 06 01:09:57.563484 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:57.563450    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a27631_0fbb_4f7f_8c9f_04a5fbcb2883.slice/crio-7dc44de865e7a512d143f0658500d8bda700065f3b4a602a1551e540f07a7600 WatchSource:0}: Error finding container 7dc44de865e7a512d143f0658500d8bda700065f3b4a602a1551e540f07a7600: Status 404 returned error can't find the container with id 7dc44de865e7a512d143f0658500d8bda700065f3b4a602a1551e540f07a7600
Sep 06 01:09:57.591440 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.591420    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sqv6l"]
Sep 06 01:09:57.593673 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:57.593649    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc36a1da_e427_4978_b31c_58b90694d7d9.slice/crio-fab1a55443c83b523aefe04272fa1715ebb0b8ee3aaea5b3fb85e088565d9afb WatchSource:0}: Error finding container fab1a55443c83b523aefe04272fa1715ebb0b8ee3aaea5b3fb85e088565d9afb: Status 404 returned error can't find the container with id fab1a55443c83b523aefe04272fa1715ebb0b8ee3aaea5b3fb85e088565d9afb
Sep 06 01:09:57.666350 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.666299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqv6l" event={"ID":"fc36a1da-e427-4978-b31c-58b90694d7d9","Type":"ContainerStarted","Data":"fab1a55443c83b523aefe04272fa1715ebb0b8ee3aaea5b3fb85e088565d9afb"}
Sep 06 01:09:57.668072 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:57.668044    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cxwgr" event={"ID":"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883","Type":"ContainerStarted","Data":"7dc44de865e7a512d143f0658500d8bda700065f3b4a602a1551e540f07a7600"}
Sep 06 01:09:58.157782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:58.157754    2557 scope.go:117] "RemoveContainer" containerID="c008b92a33e37bbaa5d2e93117409836946f621140836e2dd57a1012c73ee4d6"
Sep 06 01:09:58.674288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:58.674257    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:09:58.674460 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:58.674340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" event={"ID":"aa511636-24ee-41a0-b205-3e30836edf53","Type":"ContainerStarted","Data":"9dff5eec6f2434688a5536343a11c7474a9894e618f290881565c3bc1f4bf4e0"}
Sep 06 01:09:58.674709 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:58.674686    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:58.693491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:58.693442    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-qvj9n" podStartSLOduration=17.917004236 podStartE2EDuration="22.693422539s" totalImagesPullingTime="4.776418303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:58.69309677 +0000 UTC m=+67.018516749" watchObservedRunningTime="2026-09-06 01:09:58.693422539 +0000 UTC m=+67.018842519"
Sep 06 01:09:59.060401 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.060353    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:59.060608 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.060582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:59.063454 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.063429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87019f13-effe-48c5-8cc0-f424391f4798-metrics-tls\") pod \"dns-default-8wxkt\" (UID: \"87019f13-effe-48c5-8cc0-f424391f4798\") " pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:59.063895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.063871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"image-registry-786c879bb4-9pbc8\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") " pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:59.111302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.110934    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-qvj9n"
Sep 06 01:09:59.200542 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.200511    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x5q52\""
Sep 06 01:09:59.209197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.209160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:09:59.221916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.221891    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjq89\""
Sep 06 01:09:59.230421 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.229990    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:09:59.510321 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.510196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:09:59.513388 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:59.513346    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b31e904_433b_4a10_95f2_d5cc9759bc20.slice/crio-129350c0ede6935da4f15279b410cc7987d33c0dce9b15678e2b4f34181034b1 WatchSource:0}: Error finding container 129350c0ede6935da4f15279b410cc7987d33c0dce9b15678e2b4f34181034b1: Status 404 returned error can't find the container with id 129350c0ede6935da4f15279b410cc7987d33c0dce9b15678e2b4f34181034b1
Sep 06 01:09:59.545146 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.545045    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wxkt"]
Sep 06 01:09:59.549293 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:09:59.549269    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87019f13_effe_48c5_8cc0_f424391f4798.slice/crio-2b6b37aeec0a060c73351386080ee45dfc2ca4afabc2a1b8f98d622a2f21010e WatchSource:0}: Error finding container 2b6b37aeec0a060c73351386080ee45dfc2ca4afabc2a1b8f98d622a2f21010e: Status 404 returned error can't find the container with id 2b6b37aeec0a060c73351386080ee45dfc2ca4afabc2a1b8f98d622a2f21010e
Sep 06 01:09:59.565674 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.565646    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:59.566149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.565881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:59.566149 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:59.566054    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:59.566149 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:09:59.566138    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls podName:96c0717b-654b-4af2-9bfd-857f473cf2be nodeName:}" failed. No retries permitted until 2026-09-06 01:10:15.566099006 +0000 UTC m=+83.891518962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pmw75" (UID: "96c0717b-654b-4af2-9bfd-857f473cf2be") : secret "insights-runtime-extractor-tls" not found
Sep 06 01:09:59.566376 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.566268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/96c0717b-654b-4af2-9bfd-857f473cf2be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:09:59.681025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.680929    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wxkt" event={"ID":"87019f13-effe-48c5-8cc0-f424391f4798","Type":"ContainerStarted","Data":"2b6b37aeec0a060c73351386080ee45dfc2ca4afabc2a1b8f98d622a2f21010e"}
Sep 06 01:09:59.683492 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.683447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" event={"ID":"7b31e904-433b-4a10-95f2-d5cc9759bc20","Type":"ContainerStarted","Data":"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"}
Sep 06 01:09:59.683633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.683499    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" event={"ID":"7b31e904-433b-4a10-95f2-d5cc9759bc20","Type":"ContainerStarted","Data":"129350c0ede6935da4f15279b410cc7987d33c0dce9b15678e2b4f34181034b1"}
Sep 06 01:09:59.706241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:09:59.705952    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" podStartSLOduration=66.705931208 podStartE2EDuration="1m6.705931208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:09:59.705562973 +0000 UTC m=+68.030982951" watchObservedRunningTime="2026-09-06 01:09:59.705931208 +0000 UTC m=+68.031351203"
Sep 06 01:10:00.687723 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:00.687687    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:10:03.705886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.705853    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sqv6l" event={"ID":"fc36a1da-e427-4978-b31c-58b90694d7d9","Type":"ContainerStarted","Data":"02ac18bdf1cf926b6549964718050f3cfaebce6eda16acd43f88d7088285cd2f"}
Sep 06 01:10:03.706344 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.705977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:10:03.707525 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.707493    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cxwgr" event={"ID":"92a27631-0fbb-4f7f-8c9f-04a5fbcb2883","Type":"ContainerStarted","Data":"0d28404563f481698fcb10ac8a2b09149b8a12950c74bf704fd2243f424baf6a"}
Sep 06 01:10:03.709237 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.709214    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wxkt" event={"ID":"87019f13-effe-48c5-8cc0-f424391f4798","Type":"ContainerStarted","Data":"1e1e7ed3aa07d7dae2bfa0098641d4dcd4ccd75ecb2e74d8db7fdadf10065ee6"}
Sep 06 01:10:03.709358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.709256    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wxkt" event={"ID":"87019f13-effe-48c5-8cc0-f424391f4798","Type":"ContainerStarted","Data":"270a5d06250730e21fec004e366fafb3ce9c6f02b88bfe058f76d05ad9417ffc"}
Sep 06 01:10:03.709424 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.709376    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:10:03.722519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.722474    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sqv6l" podStartSLOduration=65.270362822 podStartE2EDuration="1m10.72245216s" totalImagesPullingTime="5.452089338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:03.721280143 +0000 UTC m=+72.046700121" watchObservedRunningTime="2026-09-06 01:10:03.72245216 +0000 UTC m=+72.047872191"
Sep 06 01:10:03.738212 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:03.738170    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8wxkt" podStartSLOduration=33.237594363 podStartE2EDuration="36.738157013s" totalImagesPullingTime="3.50056265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:03.737356701 +0000 UTC m=+72.062776679" watchObservedRunningTime="2026-09-06 01:10:03.738157013 +0000 UTC m=+72.063576988"
Sep 06 01:10:08.956887 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:08.956848    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:10:08.959302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:08.959281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/188873e6-b47d-4de0-8130-23dead3b720d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-nzvhs\" (UID: \"188873e6-b47d-4de0-8130-23dead3b720d\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:10:09.057992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.057951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:09.058178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.058048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:09.058645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.058623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dba8747c-e652-4685-804a-276d52281982-service-ca-bundle\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:09.060398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.060376    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dba8747c-e652-4685-804a-276d52281982-metrics-certs\") pod \"router-default-f886f478-psnfb\" (UID: \"dba8747c-e652-4685-804a-276d52281982\") " pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:09.141541 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.141507    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zpmq2\""
Sep 06 01:10:09.149572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.149547    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"
Sep 06 01:10:09.176259 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.176231    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kjjg8\""
Sep 06 01:10:09.184333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.184311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:09.458156 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.458088    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cxwgr" podStartSLOduration=70.964497784 podStartE2EDuration="1m16.45806876s" totalImagesPullingTime="5.493570976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:03.751814989 +0000 UTC m=+72.077234965" watchObservedRunningTime="2026-09-06 01:10:09.45806876 +0000 UTC m=+77.783488728"
Sep 06 01:10:09.458887 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.458870    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs"]
Sep 06 01:10:09.461497 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:10:09.461465    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188873e6_b47d_4de0_8130_23dead3b720d.slice/crio-012e98b5a83a48bd6739d1cd88efacb218e6cf334ddf0de60dce676560fdaa66 WatchSource:0}: Error finding container 012e98b5a83a48bd6739d1cd88efacb218e6cf334ddf0de60dce676560fdaa66: Status 404 returned error can't find the container with id 012e98b5a83a48bd6739d1cd88efacb218e6cf334ddf0de60dce676560fdaa66
Sep 06 01:10:09.489784 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.489749    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f886f478-psnfb"]
Sep 06 01:10:09.492658 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:10:09.492633    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba8747c_e652_4685_804a_276d52281982.slice/crio-f9b7ddeca30825ca653477525992bc51fb017ec65f4b66a4b0bad5fd9fad2dab WatchSource:0}: Error finding container f9b7ddeca30825ca653477525992bc51fb017ec65f4b66a4b0bad5fd9fad2dab: Status 404 returned error can't find the container with id f9b7ddeca30825ca653477525992bc51fb017ec65f4b66a4b0bad5fd9fad2dab
Sep 06 01:10:09.730959 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.730853    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f886f478-psnfb" event={"ID":"dba8747c-e652-4685-804a-276d52281982","Type":"ContainerStarted","Data":"23763cd4c2ef10c74377ed632de7bb2943b9b6c5698de1b68fa15991943cc5d5"}
Sep 06 01:10:09.730959 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.730913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f886f478-psnfb" event={"ID":"dba8747c-e652-4685-804a-276d52281982","Type":"ContainerStarted","Data":"f9b7ddeca30825ca653477525992bc51fb017ec65f4b66a4b0bad5fd9fad2dab"}
Sep 06 01:10:09.732038 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.732015    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs" event={"ID":"188873e6-b47d-4de0-8130-23dead3b720d","Type":"ContainerStarted","Data":"012e98b5a83a48bd6739d1cd88efacb218e6cf334ddf0de60dce676560fdaa66"}
Sep 06 01:10:09.749692 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:09.749640    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-f886f478-psnfb" podStartSLOduration=33.749621646 podStartE2EDuration="33.749621646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:09.748700448 +0000 UTC m=+78.074120426" watchObservedRunningTime="2026-09-06 01:10:09.749621646 +0000 UTC m=+78.075041623"
Sep 06 01:10:10.185423 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:10.185313    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:10.188183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:10.188158    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:10.736612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:10.736567    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:10.737941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:10.737912    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f886f478-psnfb"
Sep 06 01:10:11.741009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:11.740967    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs" event={"ID":"188873e6-b47d-4de0-8130-23dead3b720d","Type":"ContainerStarted","Data":"b5ba442af30287363335d4c0bf1461fc20992b2473f2785f5b5ad684394846b7"}
Sep 06 01:10:11.758933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:11.758885    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-nzvhs" podStartSLOduration=33.955066563 podStartE2EDuration="35.758865398s" totalImagesPullingTime="1.803798835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:11.757545472 +0000 UTC m=+80.082965449" watchObservedRunningTime="2026-09-06 01:10:11.758865398 +0000 UTC m=+80.084285422"
Sep 06 01:10:13.714538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:13.714503    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8wxkt"
Sep 06 01:10:15.608066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:15.607949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:10:15.610520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:15.610478    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/96c0717b-654b-4af2-9bfd-857f473cf2be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pmw75\" (UID: \"96c0717b-654b-4af2-9bfd-857f473cf2be\") " pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:10:15.614686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:15.614666    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5j6d7\""
Sep 06 01:10:15.622710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:15.622693    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pmw75"
Sep 06 01:10:15.892517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:15.892488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pmw75"]
Sep 06 01:10:15.894976 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:10:15.894948    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c0717b_654b_4af2_9bfd_857f473cf2be.slice/crio-33b26ea38733a66a402f7d58fd4c0e235613ffe433321f9372cbe4bd9e3ec750 WatchSource:0}: Error finding container 33b26ea38733a66a402f7d58fd4c0e235613ffe433321f9372cbe4bd9e3ec750: Status 404 returned error can't find the container with id 33b26ea38733a66a402f7d58fd4c0e235613ffe433321f9372cbe4bd9e3ec750
Sep 06 01:10:16.762343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:16.762266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmw75" event={"ID":"96c0717b-654b-4af2-9bfd-857f473cf2be","Type":"ContainerStarted","Data":"74c8bc7a428050e934cdbf7bd80bb81de6a07302fae402f0f84ae05be8d5ef69"}
Sep 06 01:10:16.762343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:16.762320    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmw75" event={"ID":"96c0717b-654b-4af2-9bfd-857f473cf2be","Type":"ContainerStarted","Data":"11e5b372dbd3a0bac6c89bb5aae6c8c324c1d178ff3e5a8ad6bc8839ff1bf8fc"}
Sep 06 01:10:16.762343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:16.762339    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmw75" event={"ID":"96c0717b-654b-4af2-9bfd-857f473cf2be","Type":"ContainerStarted","Data":"33b26ea38733a66a402f7d58fd4c0e235613ffe433321f9372cbe4bd9e3ec750"}
Sep 06 01:10:18.772437 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:18.772403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pmw75" event={"ID":"96c0717b-654b-4af2-9bfd-857f473cf2be","Type":"ContainerStarted","Data":"446ff99af3ecf51d87af856cec8f618f1dad7f8893f1d2152c85c27405396f57"}
Sep 06 01:10:18.791560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:18.791492    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pmw75" podStartSLOduration=33.904258674 podStartE2EDuration="35.791472958s" totalImagesPullingTime="1.887214284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:09:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:18.788588187 +0000 UTC m=+87.114008164" watchObservedRunningTime="2026-09-06 01:10:18.791472958 +0000 UTC m=+87.116892938"
Sep 06 01:10:21.701197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:21.701163    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:10:24.369161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.369122    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rwlwn"]
Sep 06 01:10:24.375081 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.375056    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.377889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.377865    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 01:10:24.378006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.377868    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qk4l2\""
Sep 06 01:10:24.378006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.377901    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 01:10:24.378006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.377941    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 01:10:24.378006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.377903    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 01:10:24.475544 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475509    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47mk\" (UniqueName: \"kubernetes.io/projected/bb628175-10e7-4be0-b1d4-3e959ddbae95-kube-api-access-r47mk\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-root\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-wtmp\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475660    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475726    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-sys\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-textfile\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475813    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-tls\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.475851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-metrics-client-ca\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.476032 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.475886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-sys\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576372    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-textfile\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-tls\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576407    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-metrics-client-ca\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576412    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-sys\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576452    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47mk\" (UniqueName: \"kubernetes.io/projected/bb628175-10e7-4be0-b1d4-3e959ddbae95-kube-api-access-r47mk\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-root\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576505    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-wtmp\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576605    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-root\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-wtmp\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.576896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.576804    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-textfile\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.577042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.577019    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-accelerators-collector-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.577042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.577029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bb628175-10e7-4be0-b1d4-3e959ddbae95-metrics-client-ca\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.578824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.578803    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-tls\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.578932 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.578838    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bb628175-10e7-4be0-b1d4-3e959ddbae95-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.586014 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.585991    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47mk\" (UniqueName: \"kubernetes.io/projected/bb628175-10e7-4be0-b1d4-3e959ddbae95-kube-api-access-r47mk\") pod \"node-exporter-rwlwn\" (UID: \"bb628175-10e7-4be0-b1d4-3e959ddbae95\") " pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.683536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.683458    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rwlwn"
Sep 06 01:10:24.694411 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:10:24.694382    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb628175_10e7_4be0_b1d4_3e959ddbae95.slice/crio-3dacbe152d3009bf283995ceb941be7d20f79f1ea0e8088ccbb5853d5eb8a907 WatchSource:0}: Error finding container 3dacbe152d3009bf283995ceb941be7d20f79f1ea0e8088ccbb5853d5eb8a907: Status 404 returned error can't find the container with id 3dacbe152d3009bf283995ceb941be7d20f79f1ea0e8088ccbb5853d5eb8a907
Sep 06 01:10:24.796170 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:24.796139    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwlwn" event={"ID":"bb628175-10e7-4be0-b1d4-3e959ddbae95","Type":"ContainerStarted","Data":"3dacbe152d3009bf283995ceb941be7d20f79f1ea0e8088ccbb5853d5eb8a907"}
Sep 06 01:10:25.801148 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:25.801095    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb628175-10e7-4be0-b1d4-3e959ddbae95" containerID="326535cb3997548573faba5743dfa73894e66f8d4a260224cc3461afe4f9bb13" exitCode=0
Sep 06 01:10:25.801545 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:25.801176    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwlwn" event={"ID":"bb628175-10e7-4be0-b1d4-3e959ddbae95","Type":"ContainerDied","Data":"326535cb3997548573faba5743dfa73894e66f8d4a260224cc3461afe4f9bb13"}
Sep 06 01:10:26.807554 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:26.807522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwlwn" event={"ID":"bb628175-10e7-4be0-b1d4-3e959ddbae95","Type":"ContainerStarted","Data":"57df45ccb50313d4cd75e9e69d08139b9d803261fab02fc63ea4351ebbc942c0"}
Sep 06 01:10:26.808045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:26.807573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rwlwn" event={"ID":"bb628175-10e7-4be0-b1d4-3e959ddbae95","Type":"ContainerStarted","Data":"381cd552af294ad22f88148a60fcbebc068c3b28b69bb24904a5f6949c1d5a4b"}
Sep 06 01:10:26.829150 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:26.829081    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rwlwn" podStartSLOduration=1.907089541 podStartE2EDuration="2.829063414s" totalImagesPullingTime="861.025421ms" totalInitContainerRuntime="60.948452ms" isStatefulPod=true podCreationTimestamp="2026-09-06 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:10:26.828053511 +0000 UTC m=+95.153473489" watchObservedRunningTime="2026-09-06 01:10:26.829063414 +0000 UTC m=+95.154483432"
Sep 06 01:10:27.546122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:27.546074    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:10:34.715078 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:34.715040    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sqv6l"
Sep 06 01:10:52.565776 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.565713    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" podUID="7b31e904-433b-4a10-95f2-d5cc9759bc20" containerName="registry" containerID="cri-o://aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d" gracePeriod=30
Sep 06 01:10:52.806430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.806406    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:10:52.901398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.901307    2557 generic.go:356] "Generic (PLEG): container finished" podID="7b31e904-433b-4a10-95f2-d5cc9759bc20" containerID="aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d" exitCode=0
Sep 06 01:10:52.901398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.901351    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8"
Sep 06 01:10:52.901398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.901355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" event={"ID":"7b31e904-433b-4a10-95f2-d5cc9759bc20","Type":"ContainerDied","Data":"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"}
Sep 06 01:10:52.901657 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.901413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-786c879bb4-9pbc8" event={"ID":"7b31e904-433b-4a10-95f2-d5cc9759bc20","Type":"ContainerDied","Data":"129350c0ede6935da4f15279b410cc7987d33c0dce9b15678e2b4f34181034b1"}
Sep 06 01:10:52.901657 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.901439    2557 scope.go:117] "RemoveContainer" containerID="aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"
Sep 06 01:10:52.905544 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905524    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905583    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905633    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8g68w\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905661    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905699    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905736    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.905915 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905768    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.906269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.905990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token\") pod \"7b31e904-433b-4a10-95f2-d5cc9759bc20\" (UID: \"7b31e904-433b-4a10-95f2-d5cc9759bc20\") "
Sep 06 01:10:52.906269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.906242    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:52.906512 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.906486    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:10:52.908465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.908435    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:52.908583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.908538    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w" (OuterVolumeSpecName: "kube-api-access-8g68w") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "kube-api-access-8g68w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:52.908698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.908674    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:10:52.908755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.908712    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:52.908815 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.908790    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:10:52.910643 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.910625    2557 scope.go:117] "RemoveContainer" containerID="aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"
Sep 06 01:10:52.911025 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:10:52.910997    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d\": container with ID starting with aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d not found: ID does not exist" containerID="aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"
Sep 06 01:10:52.911074 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.911037    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d"} err="failed to get container status \"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d\": rpc error: code = NotFound desc = could not find container \"aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d\": container with ID starting with aa013acce243b8067eb49eed60b8502fff3241cd4e8b8cfebb46dc68bcaa752d not found: ID does not exist"
Sep 06 01:10:52.915379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:52.915356    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7b31e904-433b-4a10-95f2-d5cc9759bc20" (UID: "7b31e904-433b-4a10-95f2-d5cc9759bc20"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:10:53.007627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007599    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-trusted-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007626    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007635    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7b31e904-433b-4a10-95f2-d5cc9759bc20-registry-certificates\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007646    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-bound-sa-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007655    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-image-registry-private-configuration\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007664    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7b31e904-433b-4a10-95f2-d5cc9759bc20-installation-pull-secrets\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007672    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8g68w\" (UniqueName: \"kubernetes.io/projected/7b31e904-433b-4a10-95f2-d5cc9759bc20-kube-api-access-8g68w\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.007766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.007680    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7b31e904-433b-4a10-95f2-d5cc9759bc20-ca-trust-extracted\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:10:53.222443 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.222416    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:10:53.226365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:53.226342    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-786c879bb4-9pbc8"]
Sep 06 01:10:54.162958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:54.162926    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b31e904-433b-4a10-95f2-d5cc9759bc20" path="/var/lib/kubelet/pods/7b31e904-433b-4a10-95f2-d5cc9759bc20/volumes"
Sep 06 01:10:57.362556 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:57.362509    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" podUID="596b83d7-9cd4-4386-9f44-843d755a4fb7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 01:10:58.923933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:58.923885    2557 generic.go:356] "Generic (PLEG): container finished" podID="41ffc608-485d-4522-8172-7a0daefa67b2" containerID="92473a2a84814cf7e20a7fc498f300acfcd6690ebbf763627c902c081b252f22" exitCode=0
Sep 06 01:10:58.924360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:58.923953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6" event={"ID":"41ffc608-485d-4522-8172-7a0daefa67b2","Type":"ContainerDied","Data":"92473a2a84814cf7e20a7fc498f300acfcd6690ebbf763627c902c081b252f22"}
Sep 06 01:10:58.924360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:58.924272    2557 scope.go:117] "RemoveContainer" containerID="92473a2a84814cf7e20a7fc498f300acfcd6690ebbf763627c902c081b252f22"
Sep 06 01:10:59.930046 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:10:59.930011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-frfb6" event={"ID":"41ffc608-485d-4522-8172-7a0daefa67b2","Type":"ContainerStarted","Data":"f6b85328a9af160f7686794cb654d1f792a4bcf3846c52606633a94bf99803da"}
Sep 06 01:11:01.075209 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.075173    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:11:01.077427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.077404    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6ec8321-c4d7-4610-95d4-77cb55f218ae-metrics-certs\") pod \"network-metrics-daemon-n8c6k\" (UID: \"e6ec8321-c4d7-4610-95d4-77cb55f218ae\") " pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:11:01.373629 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.373551    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rhdd5\""
Sep 06 01:11:01.377157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.377141    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-n8c6k"
Sep 06 01:11:01.644896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.644822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-n8c6k"]
Sep 06 01:11:01.647765 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:11:01.647736    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ec8321_c4d7_4610_95d4_77cb55f218ae.slice/crio-d56ec453e8e92eedbe5bb17aef87f95d94e6d68f6ef8ed9fa4582bebd5ea6d02 WatchSource:0}: Error finding container d56ec453e8e92eedbe5bb17aef87f95d94e6d68f6ef8ed9fa4582bebd5ea6d02: Status 404 returned error can't find the container with id d56ec453e8e92eedbe5bb17aef87f95d94e6d68f6ef8ed9fa4582bebd5ea6d02
Sep 06 01:11:01.938495 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:01.938404    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8c6k" event={"ID":"e6ec8321-c4d7-4610-95d4-77cb55f218ae","Type":"ContainerStarted","Data":"d56ec453e8e92eedbe5bb17aef87f95d94e6d68f6ef8ed9fa4582bebd5ea6d02"}
Sep 06 01:11:02.944324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:02.944283    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8c6k" event={"ID":"e6ec8321-c4d7-4610-95d4-77cb55f218ae","Type":"ContainerStarted","Data":"0525cc048957f9837049c062b7e9f4b41d43a726e24898220ba080dbacad15fb"}
Sep 06 01:11:02.944751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:02.944344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-n8c6k" event={"ID":"e6ec8321-c4d7-4610-95d4-77cb55f218ae","Type":"ContainerStarted","Data":"414b8b07ec4f3326850cb4a8407b7afd98ed0a4ad5d53b68cdd8a44a9d2b0e29"}
Sep 06 01:11:02.962749 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:02.962704    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-n8c6k" podStartSLOduration=129.053197967 podStartE2EDuration="2m9.962688487s" totalImagesPullingTime="909.49052ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:11:02.961598793 +0000 UTC m=+131.287018769" watchObservedRunningTime="2026-09-06 01:11:02.962688487 +0000 UTC m=+131.288108464"
Sep 06 01:11:03.949527 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:03.949497    2557 generic.go:356] "Generic (PLEG): container finished" podID="2df628eb-2a55-444f-b92f-5d5b140bcf7f" containerID="493465e4b64d311d6ccf0a1f28118126994ff02150ff1dd4606e2b680a6532c5" exitCode=0
Sep 06 01:11:03.949884 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:03.949568    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd" event={"ID":"2df628eb-2a55-444f-b92f-5d5b140bcf7f","Type":"ContainerDied","Data":"493465e4b64d311d6ccf0a1f28118126994ff02150ff1dd4606e2b680a6532c5"}
Sep 06 01:11:03.949987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:03.949971    2557 scope.go:117] "RemoveContainer" containerID="493465e4b64d311d6ccf0a1f28118126994ff02150ff1dd4606e2b680a6532c5"
Sep 06 01:11:04.954661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:04.954628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-tnqwd" event={"ID":"2df628eb-2a55-444f-b92f-5d5b140bcf7f","Type":"ContainerStarted","Data":"e4019b5f8dd07154395ac179a5a74b1ccc06ea8c96cbb09eeef215cfc78321b2"}
Sep 06 01:11:07.362542 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:07.362501    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" podUID="596b83d7-9cd4-4386-9f44-843d755a4fb7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 01:11:08.970168 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:08.970133    2557 generic.go:356] "Generic (PLEG): container finished" podID="6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10" containerID="9908d2e22f3a4f34bd3c3af193d00352d3dadb1093620093f2bf9158cc561561" exitCode=0
Sep 06 01:11:08.970534 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:08.970203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww" event={"ID":"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10","Type":"ContainerDied","Data":"9908d2e22f3a4f34bd3c3af193d00352d3dadb1093620093f2bf9158cc561561"}
Sep 06 01:11:08.970534 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:08.970526    2557 scope.go:117] "RemoveContainer" containerID="9908d2e22f3a4f34bd3c3af193d00352d3dadb1093620093f2bf9158cc561561"
Sep 06 01:11:09.975305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:09.975273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-vccww" event={"ID":"6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10","Type":"ContainerStarted","Data":"70f35a8148c029e0e357c2200404521c1a0238d7de08224c1feadc88ae0ed8db"}
Sep 06 01:11:17.362751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:17.362707    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" podUID="596b83d7-9cd4-4386-9f44-843d755a4fb7" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 06 01:11:17.363232 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:17.362785    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk"
Sep 06 01:11:17.363412 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:17.363390    2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1b359cc44dc4e82bc6340b82f0f02d91e17bc7b297d506db6108b88dc439d155"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 06 01:11:17.363485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:17.363439    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" podUID="596b83d7-9cd4-4386-9f44-843d755a4fb7" containerName="service-proxy" containerID="cri-o://1b359cc44dc4e82bc6340b82f0f02d91e17bc7b297d506db6108b88dc439d155" gracePeriod=30
Sep 06 01:11:18.007520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:18.007486    2557 generic.go:356] "Generic (PLEG): container finished" podID="596b83d7-9cd4-4386-9f44-843d755a4fb7" containerID="1b359cc44dc4e82bc6340b82f0f02d91e17bc7b297d506db6108b88dc439d155" exitCode=2
Sep 06 01:11:18.007688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:18.007534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerDied","Data":"1b359cc44dc4e82bc6340b82f0f02d91e17bc7b297d506db6108b88dc439d155"}
Sep 06 01:11:18.007688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:11:18.007570    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d54db857b-w7cqk" event={"ID":"596b83d7-9cd4-4386-9f44-843d755a4fb7","Type":"ContainerStarted","Data":"d7757c6b9298a79fefa7c18cff469da2ee94469a5b48b4be34f5f2a250dbc05b"}
Sep 06 01:13:40.619899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.619861    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"]
Sep 06 01:13:40.620365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.620211    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b31e904-433b-4a10-95f2-d5cc9759bc20" containerName="registry"
Sep 06 01:13:40.620365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.620225    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b31e904-433b-4a10-95f2-d5cc9759bc20" containerName="registry"
Sep 06 01:13:40.620365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.620276    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b31e904-433b-4a10-95f2-d5cc9759bc20" containerName="registry"
Sep 06 01:13:40.623082 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.623064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.625586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.625559    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 01:13:40.625586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.625567    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 01:13:40.625761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.625649    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2rcbr\""
Sep 06 01:13:40.625761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.625653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 01:13:40.625978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.625964    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 01:13:40.639164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.639138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"]
Sep 06 01:13:40.693767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.693728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97jps\" (UniqueName: \"kubernetes.io/projected/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-kube-api-access-97jps\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.693963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.693778    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.693963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.693812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.693963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.693888    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.693963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.693949    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.794899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.794856    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.795079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.795018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.795163 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.795078    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97jps\" (UniqueName: \"kubernetes.io/projected/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-kube-api-access-97jps\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.795163 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.795147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.795263 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.795185    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.795521 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.795487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-manifests\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.797443 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.797417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-tmp\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.797579 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.797560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.797758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.797735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.805402 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.805373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97jps\" (UniqueName: \"kubernetes.io/projected/927f0119-f6f4-4102-a28f-f0d2ad79f5b7-kube-api-access-97jps\") pod \"opendatahub-operator-controller-manager-bb49d79fd-t9ck5\" (UID: \"927f0119-f6f4-4102-a28f-f0d2ad79f5b7\") " pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:40.934007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:40.933926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:41.211374 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:41.211347    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"]
Sep 06 01:13:41.213826 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:13:41.213800    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927f0119_f6f4_4102_a28f_f0d2ad79f5b7.slice/crio-3c4e9a8df6fafa20604b4b7fb5f867b0de5d3fac1582c0294a99cb944e8c2733 WatchSource:0}: Error finding container 3c4e9a8df6fafa20604b4b7fb5f867b0de5d3fac1582c0294a99cb944e8c2733: Status 404 returned error can't find the container with id 3c4e9a8df6fafa20604b4b7fb5f867b0de5d3fac1582c0294a99cb944e8c2733
Sep 06 01:13:41.544823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:41.544735    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5" event={"ID":"927f0119-f6f4-4102-a28f-f0d2ad79f5b7","Type":"ContainerStarted","Data":"3c4e9a8df6fafa20604b4b7fb5f867b0de5d3fac1582c0294a99cb944e8c2733"}
Sep 06 01:13:44.562358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:44.562308    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5" event={"ID":"927f0119-f6f4-4102-a28f-f0d2ad79f5b7","Type":"ContainerStarted","Data":"9bdc6aab607a323b559063025c3971a24f41a5dc0444740e230ebfb36fa1c6e7"}
Sep 06 01:13:45.567952 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:45.567855    2557 generic.go:356] "Generic (PLEG): container finished" podID="927f0119-f6f4-4102-a28f-f0d2ad79f5b7" containerID="9bdc6aab607a323b559063025c3971a24f41a5dc0444740e230ebfb36fa1c6e7" exitCode=0
Sep 06 01:13:45.567952 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:45.567898    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5" event={"ID":"927f0119-f6f4-4102-a28f-f0d2ad79f5b7","Type":"ContainerDied","Data":"9bdc6aab607a323b559063025c3971a24f41a5dc0444740e230ebfb36fa1c6e7"}
Sep 06 01:13:46.574006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:46.573971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5" event={"ID":"927f0119-f6f4-4102-a28f-f0d2ad79f5b7","Type":"ContainerStarted","Data":"acb4e90cecc65e1a5b91b1af522a548176b61c07a518acc623413267764c4d65"}
Sep 06 01:13:46.574424 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:46.574056    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:13:46.595286 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:46.595231    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5" podStartSLOduration=2.278050209 podStartE2EDuration="6.595211927s" totalImagesPullingTime="3.259525033s" totalInitContainerRuntime="1.057636685s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:13:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:13:46.594234393 +0000 UTC m=+294.919654369" watchObservedRunningTime="2026-09-06 01:13:46.595211927 +0000 UTC m=+294.920631903"
Sep 06 01:13:52.093623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:52.093590    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:13:52.097217 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:52.097189    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:13:52.108177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:52.108147    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 01:13:57.581013 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:13:57.580977    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bb49d79fd-t9ck5"
Sep 06 01:14:02.479201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.479164    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"]
Sep 06 01:14:02.482293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.482275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.484884 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.484859    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 01:14:02.485026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.484860    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 01:14:02.485026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.484932    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lhc5j\""
Sep 06 01:14:02.492286 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.492261    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"]
Sep 06 01:14:02.568713 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.568672    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7718d843-9942-4be0-99f8-544b0fb4f4bb-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.568713 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.568709    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7718d843-9942-4be0-99f8-544b0fb4f4bb-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.568923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.568745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxc9t\" (UniqueName: \"kubernetes.io/projected/7718d843-9942-4be0-99f8-544b0fb4f4bb-kube-api-access-cxc9t\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.670231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.670186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxc9t\" (UniqueName: \"kubernetes.io/projected/7718d843-9942-4be0-99f8-544b0fb4f4bb-kube-api-access-cxc9t\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.670444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.670296    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7718d843-9942-4be0-99f8-544b0fb4f4bb-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.670444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.670322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7718d843-9942-4be0-99f8-544b0fb4f4bb-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.672640 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.672613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7718d843-9942-4be0-99f8-544b0fb4f4bb-tmp\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.672945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.672923    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7718d843-9942-4be0-99f8-544b0fb4f4bb-tls-certs\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.678846 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.678817    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxc9t\" (UniqueName: \"kubernetes.io/projected/7718d843-9942-4be0-99f8-544b0fb4f4bb-kube-api-access-cxc9t\") pod \"kube-auth-proxy-7cfcd8dfd7-qdqkj\" (UID: \"7718d843-9942-4be0-99f8-544b0fb4f4bb\") " pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:02.792195 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:02.792086    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"
Sep 06 01:14:03.064281 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.064252    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj"]
Sep 06 01:14:03.066332 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:14:03.066303    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7718d843_9942_4be0_99f8_544b0fb4f4bb.slice/crio-1533fc0eab2629f9cece71829674aca925db8909f9096c42df448e5aa2be69a4 WatchSource:0}: Error finding container 1533fc0eab2629f9cece71829674aca925db8909f9096c42df448e5aa2be69a4: Status 404 returned error can't find the container with id 1533fc0eab2629f9cece71829674aca925db8909f9096c42df448e5aa2be69a4
Sep 06 01:14:03.068239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.068222    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:14:03.634353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.634299    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:03.637827 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.637803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.640694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.640273    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 01:14:03.640694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.640353    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7pm9p\""
Sep 06 01:14:03.640694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.640416    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 01:14:03.640694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.640551    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 01:14:03.640694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.640690    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 01:14:03.649115 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.649072    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:03.653386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.653311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj" event={"ID":"7718d843-9942-4be0-99f8-544b0fb4f4bb","Type":"ContainerStarted","Data":"1533fc0eab2629f9cece71829674aca925db8909f9096c42df448e5aa2be69a4"}
Sep 06 01:14:03.678527 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678584    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpl84\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678619    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.678868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.678855    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779383 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpl84\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779497    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779551    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.779859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.779613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.780068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.780032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.783528 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.783500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.783656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.783640    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.783828 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.783805    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.783908 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.783873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.789691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.789621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.790441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.790395    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpl84\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84\") pod \"istiod-openshift-gateway-7b7995d5cd-5m8hx\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:03.955799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:03.955762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:04.250324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:04.250075    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:04.253999 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:14:04.253956    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded64d976_21d1_4df6_9cb0_06b1df8000b7.slice/crio-95dd87a78c75b951ea3349f17f6bcd179fdb3a1394fb624738d740d7e39a2e12 WatchSource:0}: Error finding container 95dd87a78c75b951ea3349f17f6bcd179fdb3a1394fb624738d740d7e39a2e12: Status 404 returned error can't find the container with id 95dd87a78c75b951ea3349f17f6bcd179fdb3a1394fb624738d740d7e39a2e12
Sep 06 01:14:04.664902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:04.664820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" event={"ID":"ed64d976-21d1-4df6-9cb0-06b1df8000b7","Type":"ContainerStarted","Data":"95dd87a78c75b951ea3349f17f6bcd179fdb3a1394fb624738d740d7e39a2e12"}
Sep 06 01:14:06.674479 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:06.674437    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj" event={"ID":"7718d843-9942-4be0-99f8-544b0fb4f4bb","Type":"ContainerStarted","Data":"e698c49ceecaccd43126179c27db963f0ae81b86add074e9bfe29ac2711ab42f"}
Sep 06 01:14:06.692992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:06.692933    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cfcd8dfd7-qdqkj" podStartSLOduration=2.066356829 podStartE2EDuration="4.692915534s" totalImagesPullingTime="2.626558705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:06.692398266 +0000 UTC m=+315.017818242" watchObservedRunningTime="2026-09-06 01:14:06.692915534 +0000 UTC m=+315.018335525"
Sep 06 01:14:07.861431 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:07.861396    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:14:07.861702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:07.861462    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:14:08.685403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:08.685355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" event={"ID":"ed64d976-21d1-4df6-9cb0-06b1df8000b7","Type":"ContainerStarted","Data":"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"}
Sep 06 01:14:08.685601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:08.685578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:08.687416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:08.687383    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5m8hx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:14:08.687556 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:08.687433    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:14:08.710326 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:08.710272    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" podStartSLOduration=2.105759686 podStartE2EDuration="5.710254974s" totalImagesPullingTime="3.604495288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:08.708656377 +0000 UTC m=+317.034076355" watchObservedRunningTime="2026-09-06 01:14:08.710254974 +0000 UTC m=+317.035674950"
Sep 06 01:14:09.690475 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:09.690441    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:10.551910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.551872    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ssf42"]
Sep 06 01:14:10.555287 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.555264    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:10.561026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.558494    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 06 01:14:10.561026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.558793    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-f66f9\""
Sep 06 01:14:10.570925 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.570900    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ssf42"]
Sep 06 01:14:10.640898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.640851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krct7\" (UniqueName: \"kubernetes.io/projected/dfbfddf0-54eb-4c1d-87fc-2363746d7185-kube-api-access-krct7\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:10.641052 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.640916    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:10.741800 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.741766    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krct7\" (UniqueName: \"kubernetes.io/projected/dfbfddf0-54eb-4c1d-87fc-2363746d7185-kube-api-access-krct7\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:10.742252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.741823    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:10.742252 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:14:10.741903    2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 06 01:14:10.742252 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:14:10.741951    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs podName:dfbfddf0-54eb-4c1d-87fc-2363746d7185 nodeName:}" failed. No retries permitted until 2026-09-06 01:14:11.241936135 +0000 UTC m=+319.567356090 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs") pod "model-serving-api-54d89bd5fc-ssf42" (UID: "dfbfddf0-54eb-4c1d-87fc-2363746d7185") : secret "model-serving-api-tls" not found
Sep 06 01:14:10.751083 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:10.751048    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krct7\" (UniqueName: \"kubernetes.io/projected/dfbfddf0-54eb-4c1d-87fc-2363746d7185-kube-api-access-krct7\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:11.245573 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:11.245528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:11.245754 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:14:11.245659    2557 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 06 01:14:11.245754 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:14:11.245717    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs podName:dfbfddf0-54eb-4c1d-87fc-2363746d7185 nodeName:}" failed. No retries permitted until 2026-09-06 01:14:12.245703196 +0000 UTC m=+320.571123152 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs") pod "model-serving-api-54d89bd5fc-ssf42" (UID: "dfbfddf0-54eb-4c1d-87fc-2363746d7185") : secret "model-serving-api-tls" not found
Sep 06 01:14:12.253507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:12.253468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:12.256045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:12.256019    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfbfddf0-54eb-4c1d-87fc-2363746d7185-tls-certs\") pod \"model-serving-api-54d89bd5fc-ssf42\" (UID: \"dfbfddf0-54eb-4c1d-87fc-2363746d7185\") " pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:12.369943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:12.369901    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:12.640905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:12.640877    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ssf42"]
Sep 06 01:14:12.643349 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:14:12.643323    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbfddf0_54eb_4c1d_87fc_2363746d7185.slice/crio-53068830fc0bcca8fc173b92f7c1775552d977e31a9dc58acde73aeb83529645 WatchSource:0}: Error finding container 53068830fc0bcca8fc173b92f7c1775552d977e31a9dc58acde73aeb83529645: Status 404 returned error can't find the container with id 53068830fc0bcca8fc173b92f7c1775552d977e31a9dc58acde73aeb83529645
Sep 06 01:14:12.701794 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:12.701757    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42" event={"ID":"dfbfddf0-54eb-4c1d-87fc-2363746d7185","Type":"ContainerStarted","Data":"53068830fc0bcca8fc173b92f7c1775552d977e31a9dc58acde73aeb83529645"}
Sep 06 01:14:14.712071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:14.712036    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42" event={"ID":"dfbfddf0-54eb-4c1d-87fc-2363746d7185","Type":"ContainerStarted","Data":"e730f78ea49f376810020667b574009399e654e4ef02e47c4be7ca88fe6e9a37"}
Sep 06 01:14:14.712601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:14.712162    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:14.729760 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:14.729703    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42" podStartSLOduration=3.091215042 podStartE2EDuration="4.729685283s" totalImagesPullingTime="1.638470241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:14.728378027 +0000 UTC m=+323.053798005" watchObservedRunningTime="2026-09-06 01:14:14.729685283 +0000 UTC m=+323.055105259"
Sep 06 01:14:21.216034 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.215993    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"]
Sep 06 01:14:21.219442 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.219423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.224290 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.224268    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4dfqm\""
Sep 06 01:14:21.224991 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.224971    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 06 01:14:21.245050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.245019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"]
Sep 06 01:14:21.332131 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.332071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szq7r\" (UniqueName: \"kubernetes.io/projected/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-kube-api-access-szq7r\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.332339 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.332204    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.433388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.433350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szq7r\" (UniqueName: \"kubernetes.io/projected/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-kube-api-access-szq7r\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.433589 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.433408    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.435887 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.435851    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-cert\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.441977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.441952    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szq7r\" (UniqueName: \"kubernetes.io/projected/5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d-kube-api-access-szq7r\") pod \"kserve-controller-manager-d6f4b65b8-7v55k\" (UID: \"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.529135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.529011    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:21.811397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:21.811371    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"]
Sep 06 01:14:21.813799 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:14:21.813768    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7be1c6_5c0a_4e9e_bb5a_2bb41613cc8d.slice/crio-3bf7a8d61e72208177f89a5860acb0d07dec43f3c7fddb81e9abae18fb834794 WatchSource:0}: Error finding container 3bf7a8d61e72208177f89a5860acb0d07dec43f3c7fddb81e9abae18fb834794: Status 404 returned error can't find the container with id 3bf7a8d61e72208177f89a5860acb0d07dec43f3c7fddb81e9abae18fb834794
Sep 06 01:14:22.705889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:22.705852    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:22.706396 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:22.706136    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerName="discovery" containerID="cri-o://ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c" gracePeriod=30
Sep 06 01:14:22.749153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:22.749087    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k" event={"ID":"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d","Type":"ContainerStarted","Data":"3bf7a8d61e72208177f89a5860acb0d07dec43f3c7fddb81e9abae18fb834794"}
Sep 06 01:14:22.982509 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:22.982481    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:23.146086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146048    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146152    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146221    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146266    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146294    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpl84\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146318    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.146553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.146348    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap\") pod \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\" (UID: \"ed64d976-21d1-4df6-9cb0-06b1df8000b7\") "
Sep 06 01:14:23.147242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.147207    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:14:23.149466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts" (OuterVolumeSpecName: "cacerts") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:14:23.149466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149442    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs" (OuterVolumeSpecName: "local-certs") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:14:23.149649 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149497    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:23.149706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149648    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84" (OuterVolumeSpecName: "kube-api-access-lpl84") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "kube-api-access-lpl84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:14:23.149761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149716    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:14:23.149814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.149776    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ed64d976-21d1-4df6-9cb0-06b1df8000b7" (UID: "ed64d976-21d1-4df6-9cb0-06b1df8000b7"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.247999    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-cacerts\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248029    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-ca-configmap\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248040    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-csr-dns-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248050    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248059    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed64d976-21d1-4df6-9cb0-06b1df8000b7-local-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248071    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ed64d976-21d1-4df6-9cb0-06b1df8000b7-istio-kubeconfig\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.248095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.248083    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpl84\" (UniqueName: \"kubernetes.io/projected/ed64d976-21d1-4df6-9cb0-06b1df8000b7-kube-api-access-lpl84\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:14:23.754446 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.754397    2557 generic.go:356] "Generic (PLEG): container finished" podID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerID="ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c" exitCode=0
Sep 06 01:14:23.754880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.754461    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"
Sep 06 01:14:23.754880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.754483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" event={"ID":"ed64d976-21d1-4df6-9cb0-06b1df8000b7","Type":"ContainerDied","Data":"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"}
Sep 06 01:14:23.754880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.754545    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx" event={"ID":"ed64d976-21d1-4df6-9cb0-06b1df8000b7","Type":"ContainerDied","Data":"95dd87a78c75b951ea3349f17f6bcd179fdb3a1394fb624738d740d7e39a2e12"}
Sep 06 01:14:23.754880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.754574    2557 scope.go:117] "RemoveContainer" containerID="ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"
Sep 06 01:14:23.778594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.778562    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:23.782606 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.782578    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5m8hx"]
Sep 06 01:14:23.816309 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.816286    2557 scope.go:117] "RemoveContainer" containerID="ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"
Sep 06 01:14:23.816654 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:14:23.816635    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c\": container with ID starting with ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c not found: ID does not exist" containerID="ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"
Sep 06 01:14:23.816700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:23.816664    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c"} err="failed to get container status \"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c\": rpc error: code = NotFound desc = could not find container \"ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c\": container with ID starting with ce59502c2e71ea72f40666dde142cd87dea9e7fd6749d1a32263228608472b9c not found: ID does not exist"
Sep 06 01:14:24.162501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:24.162425    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" path="/var/lib/kubelet/pods/ed64d976-21d1-4df6-9cb0-06b1df8000b7/volumes"
Sep 06 01:14:24.760621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:24.760578    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k" event={"ID":"5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d","Type":"ContainerStarted","Data":"679bdd12b8c6faac7e33a481b4b7ffa69f6a44ae8ee0bcd014cf89945ed8f665"}
Sep 06 01:14:24.760987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:24.760728    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:14:24.777588 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:24.777531    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k" podStartSLOduration=1.728747977 podStartE2EDuration="3.777513407s" totalImagesPullingTime="2.04876543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:14:24.776137739 +0000 UTC m=+333.101557719" watchObservedRunningTime="2026-09-06 01:14:24.777513407 +0000 UTC m=+333.102933406"
Sep 06 01:14:25.720324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:25.720296    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ssf42"
Sep 06 01:14:55.771670 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:14:55.771632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7v55k"
Sep 06 01:15:27.169115 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.169055    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"]
Sep 06 01:15:27.169708 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.169546    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerName="discovery"
Sep 06 01:15:27.169708 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.169566    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerName="discovery"
Sep 06 01:15:27.169708 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.169646    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed64d976-21d1-4df6-9cb0-06b1df8000b7" containerName="discovery"
Sep 06 01:15:27.172656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.172634    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:27.175422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.175396    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 01:15:27.175553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.175433    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 06 01:15:27.175553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.175440    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 01:15:27.175553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.175440    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5k6v5\""
Sep 06 01:15:27.182905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.182881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"]
Sep 06 01:15:27.273462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.273425    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk5m7\" (UniqueName: \"kubernetes.io/projected/a47d1c05-50f0-441f-a042-5aba6b4655b8-kube-api-access-jk5m7\") pod \"dns-operator-controller-manager-5985564776-mnjs2\" (UID: \"a47d1c05-50f0-441f-a042-5aba6b4655b8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:27.374181 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.374142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk5m7\" (UniqueName: \"kubernetes.io/projected/a47d1c05-50f0-441f-a042-5aba6b4655b8-kube-api-access-jk5m7\") pod \"dns-operator-controller-manager-5985564776-mnjs2\" (UID: \"a47d1c05-50f0-441f-a042-5aba6b4655b8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:27.389152 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.389118    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk5m7\" (UniqueName: \"kubernetes.io/projected/a47d1c05-50f0-441f-a042-5aba6b4655b8-kube-api-access-jk5m7\") pod \"dns-operator-controller-manager-5985564776-mnjs2\" (UID: \"a47d1c05-50f0-441f-a042-5aba6b4655b8\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:27.482641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.482599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:27.759681 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:27.759600    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"]
Sep 06 01:15:27.762790 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:27.762760    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47d1c05_50f0_441f_a042_5aba6b4655b8.slice/crio-58adedd25d8b54a0bfd1805025d8e9abebd789128b3554f1bf57ad26483deb0e WatchSource:0}: Error finding container 58adedd25d8b54a0bfd1805025d8e9abebd789128b3554f1bf57ad26483deb0e: Status 404 returned error can't find the container with id 58adedd25d8b54a0bfd1805025d8e9abebd789128b3554f1bf57ad26483deb0e
Sep 06 01:15:28.041200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:28.041096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2" event={"ID":"a47d1c05-50f0-441f-a042-5aba6b4655b8","Type":"ContainerStarted","Data":"58adedd25d8b54a0bfd1805025d8e9abebd789128b3554f1bf57ad26483deb0e"}
Sep 06 01:15:31.577047 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.577008    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"]
Sep 06 01:15:31.581538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.581517    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.584041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.584017    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fnp5\""
Sep 06 01:15:31.600575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.600544    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"]
Sep 06 01:15:31.713582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.713543    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29zfh\" (UniqueName: \"kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.713751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.713602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.814973 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.814931    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29zfh\" (UniqueName: \"kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.815177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.814987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.815367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.815350    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.823918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.823892    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29zfh\" (UniqueName: \"kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh\") pod \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:31.891963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:31.891872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:32.183480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:32.183453    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"]
Sep 06 01:15:32.185761 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:32.185729    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63d372b_3073_486b_b59a_7a757a84f3ac.slice/crio-b51a5ecb486efdbddf2a065f4171f94ca88bef523f927b32f3839c35beaaf862 WatchSource:0}: Error finding container b51a5ecb486efdbddf2a065f4171f94ca88bef523f927b32f3839c35beaaf862: Status 404 returned error can't find the container with id b51a5ecb486efdbddf2a065f4171f94ca88bef523f927b32f3839c35beaaf862
Sep 06 01:15:33.068554 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.068513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd" event={"ID":"b63d372b-3073-486b-b59a-7a757a84f3ac","Type":"ContainerStarted","Data":"b51a5ecb486efdbddf2a065f4171f94ca88bef523f927b32f3839c35beaaf862"}
Sep 06 01:15:33.544574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.544535    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"]
Sep 06 01:15:33.548255 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.548226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:33.551144 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.551098    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wg4zz\""
Sep 06 01:15:33.561306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.561278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"]
Sep 06 01:15:33.734097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.734046    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lsc\" (UniqueName: \"kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc\") pod \"limitador-operator-controller-manager-6c549b6d85-jswrv\" (UID: \"0cceae47-f742-49e3-870f-821f80bb8d63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:33.835266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.835131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lsc\" (UniqueName: \"kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc\") pod \"limitador-operator-controller-manager-6c549b6d85-jswrv\" (UID: \"0cceae47-f742-49e3-870f-821f80bb8d63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:33.845847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.845812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lsc\" (UniqueName: \"kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc\") pod \"limitador-operator-controller-manager-6c549b6d85-jswrv\" (UID: \"0cceae47-f742-49e3-870f-821f80bb8d63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:33.863627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:33.863581    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:34.166923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:34.166892    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"]
Sep 06 01:15:34.168471 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:34.168440    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cceae47_f742_49e3_870f_821f80bb8d63.slice/crio-9e6ecfc0fda460a90046005fb7f1c01588a45c69a546d8c14ca18573fadefa24 WatchSource:0}: Error finding container 9e6ecfc0fda460a90046005fb7f1c01588a45c69a546d8c14ca18573fadefa24: Status 404 returned error can't find the container with id 9e6ecfc0fda460a90046005fb7f1c01588a45c69a546d8c14ca18573fadefa24
Sep 06 01:15:35.088045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:35.088008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv" event={"ID":"0cceae47-f742-49e3-870f-821f80bb8d63","Type":"ContainerStarted","Data":"9e6ecfc0fda460a90046005fb7f1c01588a45c69a546d8c14ca18573fadefa24"}
Sep 06 01:15:36.245367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.245322    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7zpl2"]
Sep 06 01:15:36.249391 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.249357    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:36.251896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.251866    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-9pttv\""
Sep 06 01:15:36.258836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.258746    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7zpl2"]
Sep 06 01:15:36.358006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.357967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjlb\" (UniqueName: \"kubernetes.io/projected/89fd4277-6a43-4673-9511-a192aa67cb1a-kube-api-access-kqjlb\") pod \"authorino-operator-68d88948d8-7zpl2\" (UID: \"89fd4277-6a43-4673-9511-a192aa67cb1a\") " pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:36.458869 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.458829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjlb\" (UniqueName: \"kubernetes.io/projected/89fd4277-6a43-4673-9511-a192aa67cb1a-kube-api-access-kqjlb\") pod \"authorino-operator-68d88948d8-7zpl2\" (UID: \"89fd4277-6a43-4673-9511-a192aa67cb1a\") " pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:36.468486 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.468444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjlb\" (UniqueName: \"kubernetes.io/projected/89fd4277-6a43-4673-9511-a192aa67cb1a-kube-api-access-kqjlb\") pod \"authorino-operator-68d88948d8-7zpl2\" (UID: \"89fd4277-6a43-4673-9511-a192aa67cb1a\") " pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:36.563380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.563293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:36.929351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:36.929284    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-7zpl2"]
Sep 06 01:15:36.932018 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:36.931988    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fd4277_6a43_4673_9511_a192aa67cb1a.slice/crio-a7bb4676412f5c843f4a3bfd3f18fd68c3c1a0b8cb33252f6693837858c19ca0 WatchSource:0}: Error finding container a7bb4676412f5c843f4a3bfd3f18fd68c3c1a0b8cb33252f6693837858c19ca0: Status 404 returned error can't find the container with id a7bb4676412f5c843f4a3bfd3f18fd68c3c1a0b8cb33252f6693837858c19ca0
Sep 06 01:15:37.100595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:37.100512    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2" event={"ID":"89fd4277-6a43-4673-9511-a192aa67cb1a","Type":"ContainerStarted","Data":"a7bb4676412f5c843f4a3bfd3f18fd68c3c1a0b8cb33252f6693837858c19ca0"}
Sep 06 01:15:37.102472 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:37.102397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd" event={"ID":"b63d372b-3073-486b-b59a-7a757a84f3ac","Type":"ContainerStarted","Data":"466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924"}
Sep 06 01:15:37.102622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:37.102552    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:37.123945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:37.123890    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd" podStartSLOduration=1.573453752 podStartE2EDuration="6.123868149s" totalImagesPullingTime="4.550414397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:37.123063685 +0000 UTC m=+405.448483700" watchObservedRunningTime="2026-09-06 01:15:37.123868149 +0000 UTC m=+405.449288129"
Sep 06 01:15:38.111951 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:38.111860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv" event={"ID":"0cceae47-f742-49e3-870f-821f80bb8d63","Type":"ContainerStarted","Data":"9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a"}
Sep 06 01:15:39.116957 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.116923    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:39.675332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.675276    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv" podStartSLOduration=3.069956404 podStartE2EDuration="6.675256199s" totalImagesPullingTime="3.605299795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:38.133694562 +0000 UTC m=+406.459114540" watchObservedRunningTime="2026-09-06 01:15:39.675256199 +0000 UTC m=+408.000676192"
Sep 06 01:15:39.676455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.676430    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"]
Sep 06 01:15:39.679929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.679907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.682562 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.682531    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s6xvj\""
Sep 06 01:15:39.682782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.682763    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 06 01:15:39.682870 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.682851    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 06 01:15:39.685029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.685003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9jk\" (UniqueName: \"kubernetes.io/projected/e908fc12-b41e-434d-b0d6-535c190d6d58-kube-api-access-zg9jk\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.685141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.685067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.685141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.685130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e908fc12-b41e-434d-b0d6-535c190d6d58-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.687991 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.687963    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"]
Sep 06 01:15:39.786235 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.786192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.786405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.786244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e908fc12-b41e-434d-b0d6-535c190d6d58-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.786405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.786283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9jk\" (UniqueName: \"kubernetes.io/projected/e908fc12-b41e-434d-b0d6-535c190d6d58-kube-api-access-zg9jk\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.786405 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:39.786387    2557 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 06 01:15:39.786507 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:39.786458    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert podName:e908fc12-b41e-434d-b0d6-535c190d6d58 nodeName:}" failed. No retries permitted until 2026-09-06 01:15:40.286439583 +0000 UTC m=+408.611859554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert") pod "kuadrant-console-plugin-598f86468b-56z98" (UID: "e908fc12-b41e-434d-b0d6-535c190d6d58") : secret "plugin-serving-cert" not found
Sep 06 01:15:39.786845 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.786823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e908fc12-b41e-434d-b0d6-535c190d6d58-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:39.797690 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:39.797656    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9jk\" (UniqueName: \"kubernetes.io/projected/e908fc12-b41e-434d-b0d6-535c190d6d58-kube-api-access-zg9jk\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:40.123440 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.123403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2" event={"ID":"a47d1c05-50f0-441f-a042-5aba6b4655b8","Type":"ContainerStarted","Data":"d3b1b2b7c21b80daf01d07b04d22ba3ac4c5d523c3df40459615d034bb71a03d"}
Sep 06 01:15:40.123888 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.123472    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:40.125057 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.125035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2" event={"ID":"89fd4277-6a43-4673-9511-a192aa67cb1a","Type":"ContainerStarted","Data":"72c1e97c0ebc3fc15750930a54220ddda00304110d28824cdeeccfd1b7bb5ce8"}
Sep 06 01:15:40.143671 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.143624    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2" podStartSLOduration=1.783335497 podStartE2EDuration="13.143609296s" totalImagesPullingTime="11.360273799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:40.142329359 +0000 UTC m=+408.467749336" watchObservedRunningTime="2026-09-06 01:15:40.143609296 +0000 UTC m=+408.469029273"
Sep 06 01:15:40.160389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.160340    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2" podStartSLOduration=1.972752817 podStartE2EDuration="4.160320614s" totalImagesPullingTime="2.187567797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:40.159449245 +0000 UTC m=+408.484869223" watchObservedRunningTime="2026-09-06 01:15:40.160320614 +0000 UTC m=+408.485740591"
Sep 06 01:15:40.290304 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.290264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:40.292720 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.292695    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e908fc12-b41e-434d-b0d6-535c190d6d58-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-56z98\" (UID: \"e908fc12-b41e-434d-b0d6-535c190d6d58\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:40.590209 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.590154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"
Sep 06 01:15:40.859847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:40.859820    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-56z98"]
Sep 06 01:15:40.861658 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:40.861629    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode908fc12_b41e_434d_b0d6_535c190d6d58.slice/crio-d201b8adf09cbe41e4492230a275727862cfdf5fc31997eb24d1cde699fe78fd WatchSource:0}: Error finding container d201b8adf09cbe41e4492230a275727862cfdf5fc31997eb24d1cde699fe78fd: Status 404 returned error can't find the container with id d201b8adf09cbe41e4492230a275727862cfdf5fc31997eb24d1cde699fe78fd
Sep 06 01:15:41.130967 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:41.130874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98" event={"ID":"e908fc12-b41e-434d-b0d6-535c190d6d58","Type":"ContainerStarted","Data":"d201b8adf09cbe41e4492230a275727862cfdf5fc31997eb24d1cde699fe78fd"}
Sep 06 01:15:41.131423 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:41.131044    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:46.161964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:46.161926    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98" event={"ID":"e908fc12-b41e-434d-b0d6-535c190d6d58","Type":"ContainerStarted","Data":"199b4fc589e62a013aab2129233c46c180be3bdd08d978c48c719a2be6490b78"}
Sep 06 01:15:46.175527 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:46.175471    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-56z98" podStartSLOduration=2.484944882 podStartE2EDuration="7.175456245s" totalImagesPullingTime="4.690511363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:46.175371915 +0000 UTC m=+414.500791896" watchObservedRunningTime="2026-09-06 01:15:46.175456245 +0000 UTC m=+414.500876222"
Sep 06 01:15:48.114534 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:48.114497    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:49.630940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.630904    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:49.634500 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.634482    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.648717 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.648690    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:49.668530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.668498    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.668697 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.668573    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkmr8\" (UniqueName: \"kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.769687 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.769644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkmr8\" (UniqueName: \"kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.769842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.769711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.770163 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.770130    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.777810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.777782    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkmr8\" (UniqueName: \"kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8\") pod \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:49.845048 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.845011    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:49.845361 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:49.845344    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:50.121648 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.121614    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:50.125182 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:50.125150    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa698d7_dab3_4d5c_9872_0fb1b7d4d202.slice/crio-e6e57b42729fb03d87354e19c76b05a1a2569ae7f05cc1d357aca004f08d2b41 WatchSource:0}: Error finding container e6e57b42729fb03d87354e19c76b05a1a2569ae7f05cc1d357aca004f08d2b41: Status 404 returned error can't find the container with id e6e57b42729fb03d87354e19c76b05a1a2569ae7f05cc1d357aca004f08d2b41
Sep 06 01:15:50.127174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.127148    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.136000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.135976    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"]
Sep 06 01:15:50.136223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.136200    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" containerName="manager" containerID="cri-o://466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924" gracePeriod=2
Sep 06 01:15:50.140609 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.140563    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"]
Sep 06 01:15:50.159917 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:50.159803    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-mp2kd\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:50.170139 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.170088    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:15:50.170506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.170488    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" containerName="manager"
Sep 06 01:15:50.170607 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.170508    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" containerName="manager"
Sep 06 01:15:50.170667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.170610    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" containerName="manager"
Sep 06 01:15:50.173873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.173842    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.174303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.174282    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:50.180303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.180273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj" event={"ID":"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202","Type":"ContainerStarted","Data":"e6e57b42729fb03d87354e19c76b05a1a2569ae7f05cc1d357aca004f08d2b41"}
Sep 06 01:15:50.190799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.190772    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:15:50.193818 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.193794    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"]
Sep 06 01:15:50.205786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.205756    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"]
Sep 06 01:15:50.206070 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.205944    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" containerName="manager" containerID="cri-o://9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a" gracePeriod=2
Sep 06 01:15:50.211577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.211550    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"]
Sep 06 01:15:50.220038 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:50.219823    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.245405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.245371    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"]
Sep 06 01:15:50.245914 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.245867    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" containerName="manager"
Sep 06 01:15:50.245914 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.245892    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" containerName="manager"
Sep 06 01:15:50.246120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.246049    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" containerName="manager"
Sep 06 01:15:50.249188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.249168    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:50.270723 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.270629    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"]
Sep 06 01:15:50.273831 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.273806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2j6z\" (UniqueName: \"kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.273961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.273843    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77t2r\" (UniqueName: \"kubernetes.io/projected/5b1e24b9-e5b0-473f-9ef3-542c40e16b79-kube-api-access-77t2r\") pod \"limitador-operator-controller-manager-6c549b6d85-vtp5m\" (UID: \"5b1e24b9-e5b0-473f-9ef3-542c40e16b79\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:50.273961 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.273873    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.290643 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:50.290604    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.374787 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.374728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2j6z\" (UniqueName: \"kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.374787 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.374778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77t2r\" (UniqueName: \"kubernetes.io/projected/5b1e24b9-e5b0-473f-9ef3-542c40e16b79-kube-api-access-77t2r\") pod \"limitador-operator-controller-manager-6c549b6d85-vtp5m\" (UID: \"5b1e24b9-e5b0-473f-9ef3-542c40e16b79\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:50.374993 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.374810    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.375351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.375323    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.383615 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.383590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77t2r\" (UniqueName: \"kubernetes.io/projected/5b1e24b9-e5b0-473f-9ef3-542c40e16b79-kube-api-access-77t2r\") pod \"limitador-operator-controller-manager-6c549b6d85-vtp5m\" (UID: \"5b1e24b9-e5b0-473f-9ef3-542c40e16b79\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:50.383753 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.383735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2j6z\" (UniqueName: \"kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z\") pod \"kuadrant-operator-controller-manager-58fc56757c-7qnzm\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.436288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.436263    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:50.438396 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:50.438356    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.442729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.442706    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.444696 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:50.444670    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:50.476071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.476037    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58lsc\" (UniqueName: \"kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc\") pod \"0cceae47-f742-49e3-870f-821f80bb8d63\" (UID: \"0cceae47-f742-49e3-870f-821f80bb8d63\") "
Sep 06 01:15:50.476240 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.476176    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume\") pod \"b63d372b-3073-486b-b59a-7a757a84f3ac\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") "
Sep 06 01:15:50.476240 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.476220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29zfh\" (UniqueName: \"kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh\") pod \"b63d372b-3073-486b-b59a-7a757a84f3ac\" (UID: \"b63d372b-3073-486b-b59a-7a757a84f3ac\") "
Sep 06 01:15:50.476679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.476646    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b63d372b-3073-486b-b59a-7a757a84f3ac" (UID: "b63d372b-3073-486b-b59a-7a757a84f3ac"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:50.478338 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.478320    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc" (OuterVolumeSpecName: "kube-api-access-58lsc") pod "0cceae47-f742-49e3-870f-821f80bb8d63" (UID: "0cceae47-f742-49e3-870f-821f80bb8d63"). InnerVolumeSpecName "kube-api-access-58lsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:50.478533 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.478518    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh" (OuterVolumeSpecName: "kube-api-access-29zfh") pod "b63d372b-3073-486b-b59a-7a757a84f3ac" (UID: "b63d372b-3073-486b-b59a-7a757a84f3ac"). InnerVolumeSpecName "kube-api-access-29zfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:50.561774 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.561733    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:50.573824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.573798    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:50.576907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.576783    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b63d372b-3073-486b-b59a-7a757a84f3ac-extensions-socket-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:15:50.576907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.576810    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29zfh\" (UniqueName: \"kubernetes.io/projected/b63d372b-3073-486b-b59a-7a757a84f3ac-kube-api-access-29zfh\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:15:50.576907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.576825    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58lsc\" (UniqueName: \"kubernetes.io/projected/0cceae47-f742-49e3-870f-821f80bb8d63-kube-api-access-58lsc\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:15:50.842092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.842061    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:15:50.845576 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:50.845547    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1b27e1_89f6_4b57_bb9c_ba5b6ef0c6a9.slice/crio-eac7a805bb2cdcfcd24b917e2ad51bb7628194f07bd8c5b083992ff0f4de61b4 WatchSource:0}: Error finding container eac7a805bb2cdcfcd24b917e2ad51bb7628194f07bd8c5b083992ff0f4de61b4: Status 404 returned error can't find the container with id eac7a805bb2cdcfcd24b917e2ad51bb7628194f07bd8c5b083992ff0f4de61b4
Sep 06 01:15:50.855215 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:50.855087    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"]
Sep 06 01:15:50.857438 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:15:50.857418    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1e24b9_e5b0_473f_9ef3_542c40e16b79.slice/crio-48fc121828b60812d13153da525e612bcdeeba39825f8313884a8949f3356bae WatchSource:0}: Error finding container 48fc121828b60812d13153da525e612bcdeeba39825f8313884a8949f3356bae: Status 404 returned error can't find the container with id 48fc121828b60812d13153da525e612bcdeeba39825f8313884a8949f3356bae
Sep 06 01:15:51.134015 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.133938    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-mnjs2"
Sep 06 01:15:51.155476 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.155438    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.187615 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.187574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m" event={"ID":"5b1e24b9-e5b0-473f-9ef3-542c40e16b79","Type":"ContainerStarted","Data":"7fcd8945902b018fe9f3a44ef4d1681880f153fa66e14d29d724f15830782447"}
Sep 06 01:15:51.187807 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.187651    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:15:51.187807 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.187681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m" event={"ID":"5b1e24b9-e5b0-473f-9ef3-542c40e16b79","Type":"ContainerStarted","Data":"48fc121828b60812d13153da525e612bcdeeba39825f8313884a8949f3356bae"}
Sep 06 01:15:51.189501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.189470    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" containerName="manager" containerID="cri-o://798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4" gracePeriod=2
Sep 06 01:15:51.191508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.191388    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" event={"ID":"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9","Type":"ContainerStarted","Data":"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"}
Sep 06 01:15:51.191508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.191449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" event={"ID":"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9","Type":"ContainerStarted","Data":"eac7a805bb2cdcfcd24b917e2ad51bb7628194f07bd8c5b083992ff0f4de61b4"}
Sep 06 01:15:51.191508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.191477    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:15:51.193039 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.193014    2557 generic.go:356] "Generic (PLEG): container finished" podID="b63d372b-3073-486b-b59a-7a757a84f3ac" containerID="466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924" exitCode=0
Sep 06 01:15:51.193160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.193053    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-mp2kd"
Sep 06 01:15:51.193160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.193123    2557 scope.go:117] "RemoveContainer" containerID="466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924"
Sep 06 01:15:51.195031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.194965    2557 generic.go:356] "Generic (PLEG): container finished" podID="0cceae47-f742-49e3-870f-821f80bb8d63" containerID="9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a" exitCode=0
Sep 06 01:15:51.195031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.195011    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.203302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.203276    2557 scope.go:117] "RemoveContainer" containerID="466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924"
Sep 06 01:15:51.203623 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.203606    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924\": container with ID starting with 466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924 not found: ID does not exist" containerID="466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924"
Sep 06 01:15:51.203700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.203634    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924"} err="failed to get container status \"466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924\": rpc error: code = NotFound desc = could not find container \"466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924\": container with ID starting with 466771df73d9076d96a54e08c97988dd54d8fb179050d0f39314eb6136901924 not found: ID does not exist"
Sep 06 01:15:51.203700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.203655    2557 scope.go:117] "RemoveContainer" containerID="9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a"
Sep 06 01:15:51.208584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.208535    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m" podStartSLOduration=1.208521078 podStartE2EDuration="1.208521078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:51.206618694 +0000 UTC m=+419.532038672" watchObservedRunningTime="2026-09-06 01:15:51.208521078 +0000 UTC m=+419.533941055"
Sep 06 01:15:51.208684 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.208606    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.228260 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.228203    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" podStartSLOduration=1.228181782 podStartE2EDuration="1.228181782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:15:51.227269897 +0000 UTC m=+419.552689868" watchObservedRunningTime="2026-09-06 01:15:51.228181782 +0000 UTC m=+419.553601760"
Sep 06 01:15:51.229407 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.229385    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:51.231209 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.231186    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.237980 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.237950    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.239802 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.239780    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:51.241677 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.241650    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.243549 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.243512    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:51.300466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.300436    2557 scope.go:117] "RemoveContainer" containerID="9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a"
Sep 06 01:15:51.300866 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.300837    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a\": container with ID starting with 9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a not found: ID does not exist" containerID="9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a"
Sep 06 01:15:51.300941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.300879    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a"} err="failed to get container status \"9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a\": rpc error: code = NotFound desc = could not find container \"9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a\": container with ID starting with 9a4d0394409beff29009e16506c0d05434e69459233a119fe13e5509e799ba1a not found: ID does not exist"
Sep 06 01:15:51.424428 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.424401    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:51.426697 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.426674    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:51.428761 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:51.428742    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:51.483777 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.483747    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume\") pod \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") "
Sep 06 01:15:51.483939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.483788    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkmr8\" (UniqueName: \"kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8\") pod \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\" (UID: \"5fa698d7-dab3-4d5c-9872-0fb1b7d4d202\") "
Sep 06 01:15:51.484091 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.484063    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" (UID: "5fa698d7-dab3-4d5c-9872-0fb1b7d4d202"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:15:51.485873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.485847    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8" (OuterVolumeSpecName: "kube-api-access-lkmr8") pod "5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" (UID: "5fa698d7-dab3-4d5c-9872-0fb1b7d4d202"). InnerVolumeSpecName "kube-api-access-lkmr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:15:51.584693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.584652    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-extensions-socket-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:15:51.584693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:51.584686    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkmr8\" (UniqueName: \"kubernetes.io/projected/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202-kube-api-access-lkmr8\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:15:52.139303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.139279    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-7zpl2"
Sep 06 01:15:52.141710 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:52.141684    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-jswrv\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-jswrv"
Sep 06 01:15:52.163449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.163418    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cceae47-f742-49e3-870f-821f80bb8d63" path="/var/lib/kubelet/pods/0cceae47-f742-49e3-870f-821f80bb8d63/volumes"
Sep 06 01:15:52.163829 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.163815    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" path="/var/lib/kubelet/pods/5fa698d7-dab3-4d5c-9872-0fb1b7d4d202/volumes"
Sep 06 01:15:52.164196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.164181    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b63d372b-3073-486b-b59a-7a757a84f3ac" path="/var/lib/kubelet/pods/b63d372b-3073-486b-b59a-7a757a84f3ac/volumes"
Sep 06 01:15:52.165016 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:52.164990    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:52.201295 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.201264    2557 generic.go:356] "Generic (PLEG): container finished" podID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" containerID="798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4" exitCode=2
Sep 06 01:15:52.201425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.201314    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:52.201425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.201353    2557 scope.go:117] "RemoveContainer" containerID="798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4"
Sep 06 01:15:52.203850 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:52.203820    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:52.205739 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:52.205708    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-hv7wj\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-hv7wj"
Sep 06 01:15:52.209572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.209557    2557 scope.go:117] "RemoveContainer" containerID="798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4"
Sep 06 01:15:52.209862 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:15:52.209842    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4\": container with ID starting with 798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4 not found: ID does not exist" containerID="798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4"
Sep 06 01:15:52.209929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:15:52.209869    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4"} err="failed to get container status \"798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4\": rpc error: code = NotFound desc = could not find container \"798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4\": container with ID starting with 798794ce0401f9dd8ebe8de3606607272fe03b9be4d40303b3f3708c693513b4 not found: ID does not exist"
Sep 06 01:16:02.203994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:02.203962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:16:02.204519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:02.204050    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vtp5m"
Sep 06 01:16:06.424866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.424824    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:16:06.425344 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.425091    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" podUID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" containerName="manager" containerID="cri-o://3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891" gracePeriod=10
Sep 06 01:16:06.672161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.672125    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:16:06.672497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.672484    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" containerName="manager"
Sep 06 01:16:06.672553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.672498    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" containerName="manager"
Sep 06 01:16:06.672587 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.672559    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fa698d7-dab3-4d5c-9872-0fb1b7d4d202" containerName="manager"
Sep 06 01:16:06.692759 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.692729    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:16:06.692925 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.692857    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.820650 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.820600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8b7g\" (UniqueName: \"kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.820829 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.820661    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.921623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.921576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8b7g\" (UniqueName: \"kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.921623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.921627    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.921991 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.921974    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:06.931848 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:06.931810    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8b7g\" (UniqueName: \"kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-g2jlw\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:07.003413 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.003320    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:07.237659 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.237624    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:16:07.279651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.279553    2557 generic.go:356] "Generic (PLEG): container finished" podID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" containerID="3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891" exitCode=0
Sep 06 01:16:07.279651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.279603    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" event={"ID":"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9","Type":"ContainerDied","Data":"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"}
Sep 06 01:16:07.279651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.279613    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"
Sep 06 01:16:07.279920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.279681    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm" event={"ID":"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9","Type":"ContainerDied","Data":"eac7a805bb2cdcfcd24b917e2ad51bb7628194f07bd8c5b083992ff0f4de61b4"}
Sep 06 01:16:07.279920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.279709    2557 scope.go:117] "RemoveContainer" containerID="3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"
Sep 06 01:16:07.289893 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.289872    2557 scope.go:117] "RemoveContainer" containerID="3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"
Sep 06 01:16:07.290244 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:16:07.290223    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891\": container with ID starting with 3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891 not found: ID does not exist" containerID="3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"
Sep 06 01:16:07.290300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.290255    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891"} err="failed to get container status \"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891\": rpc error: code = NotFound desc = could not find container \"3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891\": container with ID starting with 3ee9a675fd2becdb8993ad6d081ab89c763276415abe95b3a1f056231e286891 not found: ID does not exist"
Sep 06 01:16:07.317021 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.316977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:16:07.319379 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:16:07.319350    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf532a803_2cac_4209_939d_17d549810a7f.slice/crio-11eb65eeb88e6a5d6392e4c078beb0150ba57440b7edab86b57b576c71be10d5 WatchSource:0}: Error finding container 11eb65eeb88e6a5d6392e4c078beb0150ba57440b7edab86b57b576c71be10d5: Status 404 returned error can't find the container with id 11eb65eeb88e6a5d6392e4c078beb0150ba57440b7edab86b57b576c71be10d5
Sep 06 01:16:07.325994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.325975    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume\") pod \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") "
Sep 06 01:16:07.326075 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.326046    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2j6z\" (UniqueName: \"kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z\") pod \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\" (UID: \"5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9\") "
Sep 06 01:16:07.326397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.326371    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" (UID: "5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:16:07.328073 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.328051    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z" (OuterVolumeSpecName: "kube-api-access-x2j6z") pod "5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" (UID: "5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9"). InnerVolumeSpecName "kube-api-access-x2j6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:07.426895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.426869    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-extensions-socket-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:16:07.426895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.426893    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2j6z\" (UniqueName: \"kubernetes.io/projected/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9-kube-api-access-x2j6z\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:16:07.603700 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.603668    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:16:07.607704 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:07.607674    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7qnzm"]
Sep 06 01:16:08.162660 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:08.162625    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" path="/var/lib/kubelet/pods/5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9/volumes"
Sep 06 01:16:08.286714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:08.286680    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" event={"ID":"f532a803-2cac-4209-939d-17d549810a7f","Type":"ContainerStarted","Data":"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"}
Sep 06 01:16:08.286899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:08.286739    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" event={"ID":"f532a803-2cac-4209-939d-17d549810a7f","Type":"ContainerStarted","Data":"11eb65eeb88e6a5d6392e4c078beb0150ba57440b7edab86b57b576c71be10d5"}
Sep 06 01:16:08.286899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:08.286825    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:08.309040 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:08.308979    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" podStartSLOduration=2.308962375 podStartE2EDuration="2.308962375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:08.307368506 +0000 UTC m=+436.632788474" watchObservedRunningTime="2026-09-06 01:16:08.308962375 +0000 UTC m=+436.634382353"
Sep 06 01:16:19.294709 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:19.294607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:16:36.992533 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.992490    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:36.993007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.992835    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" containerName="manager"
Sep 06 01:16:36.993007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.992847    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" containerName="manager"
Sep 06 01:16:36.993007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.992930    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1b27e1-89f6-4b57-bb9c-ba5b6ef0c6a9" containerName="manager"
Sep 06 01:16:36.996002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.995984    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:36.998450 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:36.998426    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 01:16:37.004564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.004535    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:37.074213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.074167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96tsw\" (UniqueName: \"kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.074411 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.074224    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.095462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.095425    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:37.175185 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.175146    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96tsw\" (UniqueName: \"kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.175185 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.175187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.175758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.175735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.187362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.187322    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96tsw\" (UniqueName: \"kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw\") pod \"limitador-limitador-859c4d96d6-8hdv2\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.306746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.306652    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:37.578579 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.578546    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:37.581215 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:16:37.581182    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf388de2_6f8b_46ed_8ad8_02629d97e390.slice/crio-281b56e50050d855275a15ebf6f47ff385ed95439061b000a7d0effc1d99953d WatchSource:0}: Error finding container 281b56e50050d855275a15ebf6f47ff385ed95439061b000a7d0effc1d99953d: Status 404 returned error can't find the container with id 281b56e50050d855275a15ebf6f47ff385ed95439061b000a7d0effc1d99953d
Sep 06 01:16:37.772367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.772330    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:37.776930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.776902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:37.779299 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.779274    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-h7fs6\""
Sep 06 01:16:37.784216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.784193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:37.879364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.879280    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:16:37.880617 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.880593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwc28\" (UniqueName: \"kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28\") pod \"authorino-b54df94b4-6gkdt\" (UID: \"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad\") " pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:37.882616 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.882599    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:16:37.890297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.890249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:16:37.981281 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.981235    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwc28\" (UniqueName: \"kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28\") pod \"authorino-b54df94b4-6gkdt\" (UID: \"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad\") " pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:37.981466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.981297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmvx\" (UniqueName: \"kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx\") pod \"authorino-c548b5d7d-b2lf5\" (UID: \"29aa0d2e-9513-4429-8764-22efe502ecf4\") " pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:16:37.989080 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:37.989053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwc28\" (UniqueName: \"kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28\") pod \"authorino-b54df94b4-6gkdt\" (UID: \"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad\") " pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:38.082503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.082461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmvx\" (UniqueName: \"kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx\") pod \"authorino-c548b5d7d-b2lf5\" (UID: \"29aa0d2e-9513-4429-8764-22efe502ecf4\") " pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:16:38.087385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.087356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:38.091511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.091485    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmvx\" (UniqueName: \"kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx\") pod \"authorino-c548b5d7d-b2lf5\" (UID: \"29aa0d2e-9513-4429-8764-22efe502ecf4\") " pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:16:38.192725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.192683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:16:38.361326 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.361292    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:38.365095 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:16:38.365060    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf8f44b5_b1eb_437e_ae7b_33fd7c5d9dad.slice/crio-f7530af6a82dcb193c18ba3f9d6ff3a74c99f336970667514093bb743bc97e9b WatchSource:0}: Error finding container f7530af6a82dcb193c18ba3f9d6ff3a74c99f336970667514093bb743bc97e9b: Status 404 returned error can't find the container with id f7530af6a82dcb193c18ba3f9d6ff3a74c99f336970667514093bb743bc97e9b
Sep 06 01:16:38.429286 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.429192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-6gkdt" event={"ID":"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad","Type":"ContainerStarted","Data":"f7530af6a82dcb193c18ba3f9d6ff3a74c99f336970667514093bb743bc97e9b"}
Sep 06 01:16:38.430345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.430321    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" event={"ID":"cf388de2-6f8b-46ed-8ad8-02629d97e390","Type":"ContainerStarted","Data":"281b56e50050d855275a15ebf6f47ff385ed95439061b000a7d0effc1d99953d"}
Sep 06 01:16:38.465012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:38.464976    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:16:38.467800 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:16:38.467761    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29aa0d2e_9513_4429_8764_22efe502ecf4.slice/crio-32633793afc72cf5f83ca3e55a4f50c20f66f2bb12ef2be1aeb6e5fe267c7d22 WatchSource:0}: Error finding container 32633793afc72cf5f83ca3e55a4f50c20f66f2bb12ef2be1aeb6e5fe267c7d22: Status 404 returned error can't find the container with id 32633793afc72cf5f83ca3e55a4f50c20f66f2bb12ef2be1aeb6e5fe267c7d22
Sep 06 01:16:39.443499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:39.443441    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" event={"ID":"cf388de2-6f8b-46ed-8ad8-02629d97e390","Type":"ContainerStarted","Data":"42717545b82ef8d2cb6c8bcaaea97c5bc62f2a8c2d3eb5166a3dae9b2e1527c3"}
Sep 06 01:16:39.443987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:39.443960    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:39.445833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:39.445801    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" event={"ID":"29aa0d2e-9513-4429-8764-22efe502ecf4","Type":"ContainerStarted","Data":"32633793afc72cf5f83ca3e55a4f50c20f66f2bb12ef2be1aeb6e5fe267c7d22"}
Sep 06 01:16:39.480043 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:39.479979    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" podStartSLOduration=1.716434031 podStartE2EDuration="3.479954212s" totalImagesPullingTime="1.763520181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:39.47823152 +0000 UTC m=+467.803651499" watchObservedRunningTime="2026-09-06 01:16:39.479954212 +0000 UTC m=+467.805374190"
Sep 06 01:16:41.462815 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:41.462773    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-6gkdt" event={"ID":"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad","Type":"ContainerStarted","Data":"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"}
Sep 06 01:16:41.464333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:41.464309    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" event={"ID":"29aa0d2e-9513-4429-8764-22efe502ecf4","Type":"ContainerStarted","Data":"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"}
Sep 06 01:16:41.478709 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:41.478657    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-6gkdt" podStartSLOduration=2.035071673 podStartE2EDuration="4.478642474s" totalImagesPullingTime="2.443570801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:41.476854769 +0000 UTC m=+469.802274747" watchObservedRunningTime="2026-09-06 01:16:41.478642474 +0000 UTC m=+469.804062450"
Sep 06 01:16:41.491810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:41.491721    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" podStartSLOduration=2.139920334 podStartE2EDuration="4.491704007s" totalImagesPullingTime="2.351783673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:16:41.490404822 +0000 UTC m=+469.815824810" watchObservedRunningTime="2026-09-06 01:16:41.491704007 +0000 UTC m=+469.817123984"
Sep 06 01:16:41.522055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:41.522014    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:43.474671 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:43.474626    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-6gkdt" podUID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" containerName="authorino" containerID="cri-o://7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e" gracePeriod=30
Sep 06 01:16:43.727750 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:43.727679    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:43.830983 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:43.830946    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwc28\" (UniqueName: \"kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28\") pod \"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad\" (UID: \"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad\") "
Sep 06 01:16:43.833079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:43.833043    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28" (OuterVolumeSpecName: "kube-api-access-rwc28") pod "af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" (UID: "af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad"). InnerVolumeSpecName "kube-api-access-rwc28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:43.931595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:43.931543    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwc28\" (UniqueName: \"kubernetes.io/projected/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad-kube-api-access-rwc28\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:16:44.480916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.480881    2557 generic.go:356] "Generic (PLEG): container finished" podID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" containerID="7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e" exitCode=0
Sep 06 01:16:44.481333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.480927    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-6gkdt"
Sep 06 01:16:44.481333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.480931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-6gkdt" event={"ID":"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad","Type":"ContainerDied","Data":"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"}
Sep 06 01:16:44.481333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.481022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-6gkdt" event={"ID":"af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad","Type":"ContainerDied","Data":"f7530af6a82dcb193c18ba3f9d6ff3a74c99f336970667514093bb743bc97e9b"}
Sep 06 01:16:44.481333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.481038    2557 scope.go:117] "RemoveContainer" containerID="7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"
Sep 06 01:16:44.489367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.489343    2557 scope.go:117] "RemoveContainer" containerID="7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"
Sep 06 01:16:44.489677 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:16:44.489657    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e\": container with ID starting with 7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e not found: ID does not exist" containerID="7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"
Sep 06 01:16:44.489727 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.489687    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e"} err="failed to get container status \"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e\": rpc error: code = NotFound desc = could not find container \"7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e\": container with ID starting with 7eee94239c040153297154478608b3d18699efe6e67ce815a0f50c18eadd117e not found: ID does not exist"
Sep 06 01:16:44.500365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.500339    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:44.508324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:44.508300    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-6gkdt"]
Sep 06 01:16:46.162672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:46.162642    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" path="/var/lib/kubelet/pods/af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad/volumes"
Sep 06 01:16:50.454097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:50.454056    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:50.620008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:50.619969    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:50.620232 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:50.620203    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" podUID="cf388de2-6f8b-46ed-8ad8-02629d97e390" containerName="limitador" containerID="cri-o://42717545b82ef8d2cb6c8bcaaea97c5bc62f2a8c2d3eb5166a3dae9b2e1527c3" gracePeriod=30
Sep 06 01:16:51.515861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.515817    2557 generic.go:356] "Generic (PLEG): container finished" podID="cf388de2-6f8b-46ed-8ad8-02629d97e390" containerID="42717545b82ef8d2cb6c8bcaaea97c5bc62f2a8c2d3eb5166a3dae9b2e1527c3" exitCode=0
Sep 06 01:16:51.516227 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.515885    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" event={"ID":"cf388de2-6f8b-46ed-8ad8-02629d97e390","Type":"ContainerDied","Data":"42717545b82ef8d2cb6c8bcaaea97c5bc62f2a8c2d3eb5166a3dae9b2e1527c3"}
Sep 06 01:16:51.569116 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.569086    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:51.697062 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.697030    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96tsw\" (UniqueName: \"kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw\") pod \"cf388de2-6f8b-46ed-8ad8-02629d97e390\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") "
Sep 06 01:16:51.697062 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.697065    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file\") pod \"cf388de2-6f8b-46ed-8ad8-02629d97e390\" (UID: \"cf388de2-6f8b-46ed-8ad8-02629d97e390\") "
Sep 06 01:16:51.697481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.697450    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file" (OuterVolumeSpecName: "config-file") pod "cf388de2-6f8b-46ed-8ad8-02629d97e390" (UID: "cf388de2-6f8b-46ed-8ad8-02629d97e390"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:16:51.699153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.699126    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw" (OuterVolumeSpecName: "kube-api-access-96tsw") pod "cf388de2-6f8b-46ed-8ad8-02629d97e390" (UID: "cf388de2-6f8b-46ed-8ad8-02629d97e390"). InnerVolumeSpecName "kube-api-access-96tsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:16:51.798045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.798010    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96tsw\" (UniqueName: \"kubernetes.io/projected/cf388de2-6f8b-46ed-8ad8-02629d97e390-kube-api-access-96tsw\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:16:51.798045 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:51.798042    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cf388de2-6f8b-46ed-8ad8-02629d97e390-config-file\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:16:52.521233 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:52.521207    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"
Sep 06 01:16:52.521233 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:52.521218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-8hdv2" event={"ID":"cf388de2-6f8b-46ed-8ad8-02629d97e390","Type":"ContainerDied","Data":"281b56e50050d855275a15ebf6f47ff385ed95439061b000a7d0effc1d99953d"}
Sep 06 01:16:52.521688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:52.521279    2557 scope.go:117] "RemoveContainer" containerID="42717545b82ef8d2cb6c8bcaaea97c5bc62f2a8c2d3eb5166a3dae9b2e1527c3"
Sep 06 01:16:52.538911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:52.538889    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:52.542971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:52.542946    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-8hdv2"]
Sep 06 01:16:54.168327 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:54.168293    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf388de2-6f8b-46ed-8ad8-02629d97e390" path="/var/lib/kubelet/pods/cf388de2-6f8b-46ed-8ad8-02629d97e390/volumes"
Sep 06 01:16:57.105932 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.105898    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"]
Sep 06 01:16:57.106306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106259    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" containerName="authorino"
Sep 06 01:16:57.106306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106273    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" containerName="authorino"
Sep 06 01:16:57.106306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106294    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf388de2-6f8b-46ed-8ad8-02629d97e390" containerName="limitador"
Sep 06 01:16:57.106306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106302    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf388de2-6f8b-46ed-8ad8-02629d97e390" containerName="limitador"
Sep 06 01:16:57.106437 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106358    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8f44b5-b1eb-437e-ae7b-33fd7c5d9dad" containerName="authorino"
Sep 06 01:16:57.106437 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.106368    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf388de2-6f8b-46ed-8ad8-02629d97e390" containerName="limitador"
Sep 06 01:16:57.110624 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.110605    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.114535 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.114515    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 06 01:16:57.114641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.114519    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mtcmk\""
Sep 06 01:16:57.114968 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.114953    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 01:16:57.115555 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.115541    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 01:16:57.122489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.122469    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"]
Sep 06 01:16:57.242408 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.242376    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-852hj\" (UniqueName: \"kubernetes.io/projected/6d043bbc-dc86-4343-a70b-dbde4a684bee-kube-api-access-852hj\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.242578 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.242412    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d043bbc-dc86-4343-a70b-dbde4a684bee-data\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.343282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.343243    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-852hj\" (UniqueName: \"kubernetes.io/projected/6d043bbc-dc86-4343-a70b-dbde4a684bee-kube-api-access-852hj\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.343282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.343283    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d043bbc-dc86-4343-a70b-dbde4a684bee-data\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.343621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.343604    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/6d043bbc-dc86-4343-a70b-dbde4a684bee-data\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.360228 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.360166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-852hj\" (UniqueName: \"kubernetes.io/projected/6d043bbc-dc86-4343-a70b-dbde4a684bee-kube-api-access-852hj\") pod \"postgres-69fb4594cf-sxd2c\" (UID: \"6d043bbc-dc86-4343-a70b-dbde4a684bee\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.421456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.421431    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:16:57.694552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:57.694528    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"]
Sep 06 01:16:57.696208 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:16:57.696181    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d043bbc_dc86_4343_a70b_dbde4a684bee.slice/crio-11480622c318c99f4495e69dc9ae44d7e5b8268bf28a2eae05ebb94baeb10d2e WatchSource:0}: Error finding container 11480622c318c99f4495e69dc9ae44d7e5b8268bf28a2eae05ebb94baeb10d2e: Status 404 returned error can't find the container with id 11480622c318c99f4495e69dc9ae44d7e5b8268bf28a2eae05ebb94baeb10d2e
Sep 06 01:16:58.554634 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:16:58.554589    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c" event={"ID":"6d043bbc-dc86-4343-a70b-dbde4a684bee","Type":"ContainerStarted","Data":"11480622c318c99f4495e69dc9ae44d7e5b8268bf28a2eae05ebb94baeb10d2e"}
Sep 06 01:17:02.580430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:02.580378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c" event={"ID":"6d043bbc-dc86-4343-a70b-dbde4a684bee","Type":"ContainerStarted","Data":"0f9f21c2d4e02093103d65a4e3aa30fca274d98a0613fa69a9da846d3aa9e330"}
Sep 06 01:17:02.580818 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:02.580544    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:17:02.597847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:02.597792    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c" podStartSLOduration=0.85187112 podStartE2EDuration="5.597775174s" totalImagesPullingTime="4.745904054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:02.596751276 +0000 UTC m=+490.922171253" watchObservedRunningTime="2026-09-06 01:17:02.597775174 +0000 UTC m=+490.923195150"
Sep 06 01:17:08.616256 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:08.616226    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-sxd2c"
Sep 06 01:17:09.162898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.162857    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-sb9mw"]
Sep 06 01:17:09.167747 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.167719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.176463 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.176436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-sb9mw"]
Sep 06 01:17:09.206964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.206922    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-sb9mw"]
Sep 06 01:17:09.207221 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:17:09.207199    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6kfff], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw" podUID="8dfdd9af-f059-4a89-9c51-5960f94ed7f1"
Sep 06 01:17:09.235971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.235935    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-k6s42"]
Sep 06 01:17:09.239346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.239326    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.241715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.241684    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 06 01:17:09.246641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.246586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-k6s42"]
Sep 06 01:17:09.254055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.253985    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kfff\" (UniqueName: \"kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff\") pod \"authorino-5dc7ccb5f-sb9mw\" (UID: \"8dfdd9af-f059-4a89-9c51-5960f94ed7f1\") " pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.355550 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.355510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqtl\" (UniqueName: \"kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.355730 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.355565    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.355730 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.355625    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kfff\" (UniqueName: \"kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff\") pod \"authorino-5dc7ccb5f-sb9mw\" (UID: \"8dfdd9af-f059-4a89-9c51-5960f94ed7f1\") " pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.366325 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.366282    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kfff\" (UniqueName: \"kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff\") pod \"authorino-5dc7ccb5f-sb9mw\" (UID: \"8dfdd9af-f059-4a89-9c51-5960f94ed7f1\") " pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.413736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.413651    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-k6s42"]
Sep 06 01:17:09.413923 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:17:09.413904    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4rqtl tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-k6s42" podUID="cd3f2948-daaa-4047-ae1c-f8a13ca6d645"
Sep 06 01:17:09.443350 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.443310    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:17:09.446891 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.446864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.454275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.454244    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:17:09.456058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.456013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqtl\" (UniqueName: \"kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.456211 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.456089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.458778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.458754    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.466684 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.466654    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqtl\" (UniqueName: \"kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl\") pod \"authorino-687bd45585-k6s42\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") " pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.557441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.557398    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.557629 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.557517    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsszh\" (UniqueName: \"kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.613469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.613425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.613623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.613425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.620924 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.620896    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:09.623868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.623849    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:09.658456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.658419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsszh\" (UniqueName: \"kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.658641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.658471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.660940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.660916    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.666691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.666629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsszh\" (UniqueName: \"kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh\") pod \"authorino-7cc48b545f-md4mf\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") " pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.758384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.758334    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:17:09.759575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.759551    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kfff\" (UniqueName: \"kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff\") pod \"8dfdd9af-f059-4a89-9c51-5960f94ed7f1\" (UID: \"8dfdd9af-f059-4a89-9c51-5960f94ed7f1\") "
Sep 06 01:17:09.759633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.759605    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert\") pod \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") "
Sep 06 01:17:09.759673 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.759635    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rqtl\" (UniqueName: \"kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl\") pod \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\" (UID: \"cd3f2948-daaa-4047-ae1c-f8a13ca6d645\") "
Sep 06 01:17:09.761871 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.761785    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff" (OuterVolumeSpecName: "kube-api-access-6kfff") pod "8dfdd9af-f059-4a89-9c51-5960f94ed7f1" (UID: "8dfdd9af-f059-4a89-9c51-5960f94ed7f1"). InnerVolumeSpecName "kube-api-access-6kfff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:17:09.761871 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.761791    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cd3f2948-daaa-4047-ae1c-f8a13ca6d645" (UID: "cd3f2948-daaa-4047-ae1c-f8a13ca6d645"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:17:09.761871 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.761788    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl" (OuterVolumeSpecName: "kube-api-access-4rqtl") pod "cd3f2948-daaa-4047-ae1c-f8a13ca6d645" (UID: "cd3f2948-daaa-4047-ae1c-f8a13ca6d645"). InnerVolumeSpecName "kube-api-access-4rqtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:17:09.860725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.860678    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kfff\" (UniqueName: \"kubernetes.io/projected/8dfdd9af-f059-4a89-9c51-5960f94ed7f1-kube-api-access-6kfff\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:17:09.860725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.860718    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-tls-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:17:09.860725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:09.860728    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rqtl\" (UniqueName: \"kubernetes.io/projected/cd3f2948-daaa-4047-ae1c-f8a13ca6d645-kube-api-access-4rqtl\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:17:10.027913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.027668    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:17:10.030115 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:17:10.030070    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b27373_5f48_4e3b_8a66_008d031b19f8.slice/crio-ad3ee86414e5e487e34fced8eb21eb4b1a204389716e6ebcd676e2260875064a WatchSource:0}: Error finding container ad3ee86414e5e487e34fced8eb21eb4b1a204389716e6ebcd676e2260875064a: Status 404 returned error can't find the container with id ad3ee86414e5e487e34fced8eb21eb4b1a204389716e6ebcd676e2260875064a
Sep 06 01:17:10.619222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.619184    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-sb9mw"
Sep 06 01:17:10.619222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.619203    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc48b545f-md4mf" event={"ID":"d8b27373-5f48-4e3b-8a66-008d031b19f8","Type":"ContainerStarted","Data":"ad3ee86414e5e487e34fced8eb21eb4b1a204389716e6ebcd676e2260875064a"}
Sep 06 01:17:10.619485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.619350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-k6s42"
Sep 06 01:17:10.651577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.647360    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-sb9mw"]
Sep 06 01:17:10.653842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.653798    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-sb9mw"]
Sep 06 01:17:10.679232 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.679195    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-k6s42"]
Sep 06 01:17:10.682440 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:10.682409    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-k6s42"]
Sep 06 01:17:11.625410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:11.625370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc48b545f-md4mf" event={"ID":"d8b27373-5f48-4e3b-8a66-008d031b19f8","Type":"ContainerStarted","Data":"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"}
Sep 06 01:17:11.641012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:11.640960    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cc48b545f-md4mf" podStartSLOduration=1.949737318 podStartE2EDuration="2.640944248s" totalImagesPullingTime="691.20693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:11.64053073 +0000 UTC m=+499.965950706" watchObservedRunningTime="2026-09-06 01:17:11.640944248 +0000 UTC m=+499.966364225"
Sep 06 01:17:11.669325 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:11.669285    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:17:11.669723 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:11.669526    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" podUID="29aa0d2e-9513-4429-8764-22efe502ecf4" containerName="authorino" containerID="cri-o://63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47" gracePeriod=30
Sep 06 01:17:11.920913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:11.920886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:17:12.079078 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.079039    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mmvx\" (UniqueName: \"kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx\") pod \"29aa0d2e-9513-4429-8764-22efe502ecf4\" (UID: \"29aa0d2e-9513-4429-8764-22efe502ecf4\") "
Sep 06 01:17:12.081278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.081253    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx" (OuterVolumeSpecName: "kube-api-access-8mmvx") pod "29aa0d2e-9513-4429-8764-22efe502ecf4" (UID: "29aa0d2e-9513-4429-8764-22efe502ecf4"). InnerVolumeSpecName "kube-api-access-8mmvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:17:12.162940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.162859    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dfdd9af-f059-4a89-9c51-5960f94ed7f1" path="/var/lib/kubelet/pods/8dfdd9af-f059-4a89-9c51-5960f94ed7f1/volumes"
Sep 06 01:17:12.163134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.163121    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd3f2948-daaa-4047-ae1c-f8a13ca6d645" path="/var/lib/kubelet/pods/cd3f2948-daaa-4047-ae1c-f8a13ca6d645/volumes"
Sep 06 01:17:12.180222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.180197    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mmvx\" (UniqueName: \"kubernetes.io/projected/29aa0d2e-9513-4429-8764-22efe502ecf4-kube-api-access-8mmvx\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:17:12.631355 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.631320    2557 generic.go:356] "Generic (PLEG): container finished" podID="29aa0d2e-9513-4429-8764-22efe502ecf4" containerID="63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47" exitCode=0
Sep 06 01:17:12.631546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.631363    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-b2lf5"
Sep 06 01:17:12.631546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.631410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" event={"ID":"29aa0d2e-9513-4429-8764-22efe502ecf4","Type":"ContainerDied","Data":"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"}
Sep 06 01:17:12.631546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.631451    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-b2lf5" event={"ID":"29aa0d2e-9513-4429-8764-22efe502ecf4","Type":"ContainerDied","Data":"32633793afc72cf5f83ca3e55a4f50c20f66f2bb12ef2be1aeb6e5fe267c7d22"}
Sep 06 01:17:12.631546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.631469    2557 scope.go:117] "RemoveContainer" containerID="63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"
Sep 06 01:17:12.639862 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.639838    2557 scope.go:117] "RemoveContainer" containerID="63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"
Sep 06 01:17:12.640134 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:17:12.640115    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47\": container with ID starting with 63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47 not found: ID does not exist" containerID="63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"
Sep 06 01:17:12.640193 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.640144    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47"} err="failed to get container status \"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47\": rpc error: code = NotFound desc = could not find container \"63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47\": container with ID starting with 63d3b0a58e9ffc918013b2a27c13dbfe3e977f1db1cc71e25cc4cca80d85ec47 not found: ID does not exist"
Sep 06 01:17:12.647142 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.647079    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:17:12.649191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:12.649170    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-b2lf5"]
Sep 06 01:17:14.162584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:14.162547    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29aa0d2e-9513-4429-8764-22efe502ecf4" path="/var/lib/kubelet/pods/29aa0d2e-9513-4429-8764-22efe502ecf4/volumes"
Sep 06 01:17:16.557391 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.557355    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:17:16.557808 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.557693    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29aa0d2e-9513-4429-8764-22efe502ecf4" containerName="authorino"
Sep 06 01:17:16.557808 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.557704    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="29aa0d2e-9513-4429-8764-22efe502ecf4" containerName="authorino"
Sep 06 01:17:16.557808 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.557788    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="29aa0d2e-9513-4429-8764-22efe502ecf4" containerName="authorino"
Sep 06 01:17:16.560849 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.560827    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.564705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.564684    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f8grl\""
Sep 06 01:17:16.564842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.564791    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:17:16.564842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.564805    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:17:16.564842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.564818    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:17:16.572247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.572221    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:17:16.722191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.722151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.722191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.722190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.722409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.722294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdhd8\" (UniqueName: \"kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.823096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.822986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.823096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.823040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.823363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.823145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdhd8\" (UniqueName: \"kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.825591 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.825569    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.825682 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.825606    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.836079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.836046    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdhd8\" (UniqueName: \"kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8\") pod \"maas-controller-6d8ddb49f9-f94tb\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") " pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:16.871945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:16.871907    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:17.147835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:17.147800    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:17:17.150149 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:17:17.150097    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a64905_add5_490e_b5a8_1b2a5e91eaa4.slice/crio-0e2ebde19c122ecc978785b9bbd71f41ecda812f1a1b2f7cd6ad1394f583e4e2 WatchSource:0}: Error finding container 0e2ebde19c122ecc978785b9bbd71f41ecda812f1a1b2f7cd6ad1394f583e4e2: Status 404 returned error can't find the container with id 0e2ebde19c122ecc978785b9bbd71f41ecda812f1a1b2f7cd6ad1394f583e4e2
Sep 06 01:17:17.664200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:17.664152    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" event={"ID":"04a64905-add5-490e-b5a8-1b2a5e91eaa4","Type":"ContainerStarted","Data":"0e2ebde19c122ecc978785b9bbd71f41ecda812f1a1b2f7cd6ad1394f583e4e2"}
Sep 06 01:17:19.676911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:19.676803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" event={"ID":"04a64905-add5-490e-b5a8-1b2a5e91eaa4","Type":"ContainerStarted","Data":"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"}
Sep 06 01:17:19.677341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:19.676970    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:19.695995 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:19.695931    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" podStartSLOduration=1.485624464 podStartE2EDuration="3.69591507s" totalImagesPullingTime="2.210290606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:19.694609739 +0000 UTC m=+508.020029716" watchObservedRunningTime="2026-09-06 01:17:19.69591507 +0000 UTC m=+508.021335047"
Sep 06 01:17:30.683625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:30.683591    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:17:52.840061 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.840027    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"]
Sep 06 01:17:52.846044 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.846023    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:52.849364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.849343    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-h6r5c\""
Sep 06 01:17:52.849459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.849418    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 01:17:52.854182 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.854158    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"]
Sep 06 01:17:52.931789 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.931753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1032924f-06fc-45c3-8ec4-4becab0c607f-openshift-service-ca\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:52.931979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.931801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1032924f-06fc-45c3-8ec4-4becab0c607f-maas-api-tls\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:52.931979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:52.931873    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggcgb\" (UniqueName: \"kubernetes.io/projected/1032924f-06fc-45c3-8ec4-4becab0c607f-kube-api-access-ggcgb\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.033077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.033045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggcgb\" (UniqueName: \"kubernetes.io/projected/1032924f-06fc-45c3-8ec4-4becab0c607f-kube-api-access-ggcgb\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.033245 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.033171    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1032924f-06fc-45c3-8ec4-4becab0c607f-openshift-service-ca\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.033245 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.033206    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1032924f-06fc-45c3-8ec4-4becab0c607f-maas-api-tls\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.033788 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.033757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1032924f-06fc-45c3-8ec4-4becab0c607f-openshift-service-ca\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.035577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.035555    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1032924f-06fc-45c3-8ec4-4becab0c607f-maas-api-tls\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.043053 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.043030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggcgb\" (UniqueName: \"kubernetes.io/projected/1032924f-06fc-45c3-8ec4-4becab0c607f-kube-api-access-ggcgb\") pod \"maas-api-b7787bf5-2t6bg\" (UID: \"1032924f-06fc-45c3-8ec4-4becab0c607f\") " pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.157536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.157454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:53.195208 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.195175    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"]
Sep 06 01:17:53.198638 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.198613    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.202994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.202970    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 01:17:53.203736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.203011    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8pr66\""
Sep 06 01:17:53.217237 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.216665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"]
Sep 06 01:17:53.336729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.336695    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1ae75ab-d8f3-493b-92a4-c47e94955f41-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.336729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.336738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcswt\" (UniqueName: \"kubernetes.io/projected/b1ae75ab-d8f3-493b-92a4-c47e94955f41-kube-api-access-mcswt\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.430519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.430484    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"]
Sep 06 01:17:53.431910 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:17:53.431868    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1032924f_06fc_45c3_8ec4_4becab0c607f.slice/crio-d2c4c4d96d9b9ae9bb71829ae25c22e68d995f58a6dff5ff06c9f4fa7630ee0a WatchSource:0}: Error finding container d2c4c4d96d9b9ae9bb71829ae25c22e68d995f58a6dff5ff06c9f4fa7630ee0a: Status 404 returned error can't find the container with id d2c4c4d96d9b9ae9bb71829ae25c22e68d995f58a6dff5ff06c9f4fa7630ee0a
Sep 06 01:17:53.437266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.437237    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1ae75ab-d8f3-493b-92a4-c47e94955f41-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.437372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.437275    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcswt\" (UniqueName: \"kubernetes.io/projected/b1ae75ab-d8f3-493b-92a4-c47e94955f41-kube-api-access-mcswt\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.438315 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.438213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1ae75ab-d8f3-493b-92a4-c47e94955f41-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.445810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.445786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcswt\" (UniqueName: \"kubernetes.io/projected/b1ae75ab-d8f3-493b-92a4-c47e94955f41-kube-api-access-mcswt\") pod \"payload-pre-processing-59fbc47bf8-8n29j\" (UID: \"b1ae75ab-d8f3-493b-92a4-c47e94955f41\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.511983 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.511948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:53.793348 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.793321    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"]
Sep 06 01:17:53.795942 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:17:53.795908    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ae75ab_d8f3_493b_92a4_c47e94955f41.slice/crio-cb62fd775d35d3f6e8872828743693f79feeb3d59d733b23f365e4df89d7a8ea WatchSource:0}: Error finding container cb62fd775d35d3f6e8872828743693f79feeb3d59d733b23f365e4df89d7a8ea: Status 404 returned error can't find the container with id cb62fd775d35d3f6e8872828743693f79feeb3d59d733b23f365e4df89d7a8ea
Sep 06 01:17:53.837025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.836997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg" event={"ID":"1032924f-06fc-45c3-8ec4-4becab0c607f","Type":"ContainerStarted","Data":"d2c4c4d96d9b9ae9bb71829ae25c22e68d995f58a6dff5ff06c9f4fa7630ee0a"}
Sep 06 01:17:53.838144 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:53.838097    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j" event={"ID":"b1ae75ab-d8f3-493b-92a4-c47e94955f41","Type":"ContainerStarted","Data":"cb62fd775d35d3f6e8872828743693f79feeb3d59d733b23f365e4df89d7a8ea"}
Sep 06 01:17:55.851868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:55.851828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg" event={"ID":"1032924f-06fc-45c3-8ec4-4becab0c607f","Type":"ContainerStarted","Data":"9f7eedb390580cd6871b708d76d431e27639baeb1452ac9e0e86708ef1e18ef6"}
Sep 06 01:17:55.852305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:55.851974    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:17:55.872236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:55.872178    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg" podStartSLOduration=2.376173123 podStartE2EDuration="3.872157789s" totalImagesPullingTime="1.495984666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:55.869460703 +0000 UTC m=+544.194880681" watchObservedRunningTime="2026-09-06 01:17:55.872157789 +0000 UTC m=+544.197577768"
Sep 06 01:17:56.858775 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:56.858736    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j" event={"ID":"b1ae75ab-d8f3-493b-92a4-c47e94955f41","Type":"ContainerStarted","Data":"426b2cf2a031beaaafb3029f6ec5ce587b77c10708e6220a6ef4f8d447e1dade"}
Sep 06 01:17:56.859186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:56.858820    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:17:56.874005 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:17:56.873957    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j" podStartSLOduration=1.505903497 podStartE2EDuration="3.873940362s" totalImagesPullingTime="2.368036865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:17:56.873652323 +0000 UTC m=+545.199072311" watchObservedRunningTime="2026-09-06 01:17:56.873940362 +0000 UTC m=+545.199360340"
Sep 06 01:18:01.864345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:18:01.864312    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b7787bf5-2t6bg"
Sep 06 01:18:07.865796 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:18:07.865764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-8n29j"
Sep 06 01:18:52.127411 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:18:52.127382    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:18:52.128408 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:18:52.128384    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:20:10.753550 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.753512    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-65b75fb4cd-9gc2k"]
Sep 06 01:20:10.757076 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.757052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.766979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.766948    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b75fb4cd-9gc2k"]
Sep 06 01:20:10.834487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.834450    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwsf4\" (UniqueName: \"kubernetes.io/projected/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-kube-api-access-xwsf4\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.834644 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.834523    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-tls-cert\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.935444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.935407    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwsf4\" (UniqueName: \"kubernetes.io/projected/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-kube-api-access-xwsf4\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.935609 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.935459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-tls-cert\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.938011 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.937984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-tls-cert\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:10.943194 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:10.943173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwsf4\" (UniqueName: \"kubernetes.io/projected/5cd795d7-7a06-4dc2-84dc-b917d30c5f16-kube-api-access-xwsf4\") pod \"authorino-65b75fb4cd-9gc2k\" (UID: \"5cd795d7-7a06-4dc2-84dc-b917d30c5f16\") " pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:11.066620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:11.066530    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-65b75fb4cd-9gc2k"
Sep 06 01:20:11.336746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:11.336721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-65b75fb4cd-9gc2k"]
Sep 06 01:20:11.338872 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:11.338843    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cd795d7_7a06_4dc2_84dc_b917d30c5f16.slice/crio-4c65b65e4af38ed13de268af449c61385c20e7d1754faac5eba03b757fb01c11 WatchSource:0}: Error finding container 4c65b65e4af38ed13de268af449c61385c20e7d1754faac5eba03b757fb01c11: Status 404 returned error can't find the container with id 4c65b65e4af38ed13de268af449c61385c20e7d1754faac5eba03b757fb01c11
Sep 06 01:20:11.340272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:11.340246    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:20:11.497146 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:11.497083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b75fb4cd-9gc2k" event={"ID":"5cd795d7-7a06-4dc2-84dc-b917d30c5f16","Type":"ContainerStarted","Data":"4c65b65e4af38ed13de268af449c61385c20e7d1754faac5eba03b757fb01c11"}
Sep 06 01:20:12.504168 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.504079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-65b75fb4cd-9gc2k" event={"ID":"5cd795d7-7a06-4dc2-84dc-b917d30c5f16","Type":"ContainerStarted","Data":"da44027231fd1057a7233e05f4ea69e522ec84b58d78cf93949254454afb7a94"}
Sep 06 01:20:12.521452 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.521384    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-65b75fb4cd-9gc2k" podStartSLOduration=1.702046697 podStartE2EDuration="2.521368181s" totalImagesPullingTime="819.321484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:12.520064616 +0000 UTC m=+680.845484593" watchObservedRunningTime="2026-09-06 01:20:12.521368181 +0000 UTC m=+680.846788157"
Sep 06 01:20:12.550770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.550734    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:20:12.551622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.551566    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7cc48b545f-md4mf" podUID="d8b27373-5f48-4e3b-8a66-008d031b19f8" containerName="authorino" containerID="cri-o://05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b" gracePeriod=30
Sep 06 01:20:12.806799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.806769    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:20:12.854047 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.853688    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsszh\" (UniqueName: \"kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh\") pod \"d8b27373-5f48-4e3b-8a66-008d031b19f8\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") "
Sep 06 01:20:12.854047 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.853745    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert\") pod \"d8b27373-5f48-4e3b-8a66-008d031b19f8\" (UID: \"d8b27373-5f48-4e3b-8a66-008d031b19f8\") "
Sep 06 01:20:12.864240 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.864185    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh" (OuterVolumeSpecName: "kube-api-access-bsszh") pod "d8b27373-5f48-4e3b-8a66-008d031b19f8" (UID: "d8b27373-5f48-4e3b-8a66-008d031b19f8"). InnerVolumeSpecName "kube-api-access-bsszh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:12.874182 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.874147    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8b27373-5f48-4e3b-8a66-008d031b19f8" (UID: "d8b27373-5f48-4e3b-8a66-008d031b19f8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:20:12.954624 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.954582    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsszh\" (UniqueName: \"kubernetes.io/projected/d8b27373-5f48-4e3b-8a66-008d031b19f8-kube-api-access-bsszh\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:20:12.954624 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:12.954621    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b27373-5f48-4e3b-8a66-008d031b19f8-tls-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:20:13.510353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.510322    2557 generic.go:356] "Generic (PLEG): container finished" podID="d8b27373-5f48-4e3b-8a66-008d031b19f8" containerID="05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b" exitCode=0
Sep 06 01:20:13.510810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.510360    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc48b545f-md4mf"
Sep 06 01:20:13.510810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.510407    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc48b545f-md4mf" event={"ID":"d8b27373-5f48-4e3b-8a66-008d031b19f8","Type":"ContainerDied","Data":"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"}
Sep 06 01:20:13.510810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.510447    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc48b545f-md4mf" event={"ID":"d8b27373-5f48-4e3b-8a66-008d031b19f8","Type":"ContainerDied","Data":"ad3ee86414e5e487e34fced8eb21eb4b1a204389716e6ebcd676e2260875064a"}
Sep 06 01:20:13.510810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.510464    2557 scope.go:117] "RemoveContainer" containerID="05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"
Sep 06 01:20:13.521351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.521331    2557 scope.go:117] "RemoveContainer" containerID="05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"
Sep 06 01:20:13.521727 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:13.521701    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b\": container with ID starting with 05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b not found: ID does not exist" containerID="05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"
Sep 06 01:20:13.521806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.521739    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b"} err="failed to get container status \"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b\": rpc error: code = NotFound desc = could not find container \"05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b\": container with ID starting with 05ca0ded60621c91142c6aea1e0d24756c56cf5d1db13efbb0d28944b391222b not found: ID does not exist"
Sep 06 01:20:13.531112 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.531077    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:20:13.539228 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:13.539206    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7cc48b545f-md4mf"]
Sep 06 01:20:14.162931 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:14.162891    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b27373-5f48-4e3b-8a66-008d031b19f8" path="/var/lib/kubelet/pods/d8b27373-5f48-4e3b-8a66-008d031b19f8/volumes"
Sep 06 01:20:29.944362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.944329    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:20:29.944873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.944852    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b27373-5f48-4e3b-8a66-008d031b19f8" containerName="authorino"
Sep 06 01:20:29.944947 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.944876    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b27373-5f48-4e3b-8a66-008d031b19f8" containerName="authorino"
Sep 06 01:20:29.945037 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.945024    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b27373-5f48-4e3b-8a66-008d031b19f8" containerName="authorino"
Sep 06 01:20:29.948554 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.948532    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:29.951639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.951617    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 01:20:29.951855 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.951834    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-b63fa0-openshift-default-dockercfg-27x66\""
Sep 06 01:20:29.963661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:29.963639    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:20:30.097552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097514    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097610    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff8lm\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097647    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.097989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.097938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.198860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.198792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.198860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.198832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199070 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.198878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199070 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.198906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199070 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.198935    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199081    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199178    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8lm\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199460 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199397    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199461    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199360    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199609 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.199776 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.199744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.201420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.201397    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.201543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.201445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.207631 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.207609    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8lm\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.207939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.207920    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token\") pod \"e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") " pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.261060 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.261032    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:30.537847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.537821    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:20:30.539997 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:30.539972    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e640c0_7b8b_4d8e_a09b_9169bb60ae51.slice/crio-5d855fee67c9bbde78a3af66673d5e04d9d38dfb0072d92ef5fb6fb31938f199 WatchSource:0}: Error finding container 5d855fee67c9bbde78a3af66673d5e04d9d38dfb0072d92ef5fb6fb31938f199: Status 404 returned error can't find the container with id 5d855fee67c9bbde78a3af66673d5e04d9d38dfb0072d92ef5fb6fb31938f199
Sep 06 01:20:30.591674 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:30.591633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerStarted","Data":"5d855fee67c9bbde78a3af66673d5e04d9d38dfb0072d92ef5fb6fb31938f199"}
Sep 06 01:20:31.457128 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.457070    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7767-140351588748464"]
Sep 06 01:20:31.460722 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.460700    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:31.463360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.463336    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hggws\""
Sep 06 01:20:31.465490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.465442    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7767-140351588748464"]
Sep 06 01:20:31.612582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.612553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4ptt\" (UniqueName: \"kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt\") pod \"test-curl-7767-140351588748464\" (UID: \"073393a9-014d-4444-881a-4e8f6bba0b97\") " pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:31.713335 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.713216    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4ptt\" (UniqueName: \"kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt\") pod \"test-curl-7767-140351588748464\" (UID: \"073393a9-014d-4444-881a-4e8f6bba0b97\") " pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:31.721994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.721969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4ptt\" (UniqueName: \"kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt\") pod \"test-curl-7767-140351588748464\" (UID: \"073393a9-014d-4444-881a-4e8f6bba0b97\") " pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:31.773081 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:31.773044    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:32.059235 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:32.059208    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7767-140351588748464"]
Sep 06 01:20:32.061768 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:32.061721    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod073393a9_014d_4444_881a_4e8f6bba0b97.slice/crio-78f9e09ed23043b5c652173595ca33e353e74809a1da607859f69274e3383849 WatchSource:0}: Error finding container 78f9e09ed23043b5c652173595ca33e353e74809a1da607859f69274e3383849: Status 404 returned error can't find the container with id 78f9e09ed23043b5c652173595ca33e353e74809a1da607859f69274e3383849
Sep 06 01:20:32.603726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:32.603695    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7767-140351588748464" event={"ID":"073393a9-014d-4444-881a-4e8f6bba0b97","Type":"ContainerStarted","Data":"78f9e09ed23043b5c652173595ca33e353e74809a1da607859f69274e3383849"}
Sep 06 01:20:33.230697 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:33.230661    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:33.230789 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:33.230745    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:33.230826 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:33.230792    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:33.611058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:33.610963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerStarted","Data":"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"}
Sep 06 01:20:33.633417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:33.633350    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podStartSLOduration=1.9455285180000002 podStartE2EDuration="4.633333368s" totalImagesPullingTime="2.68780485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:33.631037229 +0000 UTC m=+701.956457230" watchObservedRunningTime="2026-09-06 01:20:33.633333368 +0000 UTC m=+701.958753344"
Sep 06 01:20:34.261360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:34.261328    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:34.267277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:34.267249    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:34.623043 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:34.622958    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:34.624154 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:34.624124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:35.630853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:35.630818    2557 generic.go:356] "Generic (PLEG): container finished" podID="073393a9-014d-4444-881a-4e8f6bba0b97" containerID="3cf630be68c56497c146099ae906fe3b1288bd9c0fa5759d0ad254d53a5705b0" exitCode=0
Sep 06 01:20:35.631259 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:35.630905    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7767-140351588748464" event={"ID":"073393a9-014d-4444-881a-4e8f6bba0b97","Type":"ContainerDied","Data":"3cf630be68c56497c146099ae906fe3b1288bd9c0fa5759d0ad254d53a5705b0"}
Sep 06 01:20:36.625399 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.625364    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:20:36.629799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.629772    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.632283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.632257    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-b63fa0-serving-cert\""
Sep 06 01:20:36.641362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.641337    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:20:36.761093 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.761054    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.761238 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.761124    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.761309 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.761256    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thvmn\" (UniqueName: \"kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.779418 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.779393    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:36.811782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.811749    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7767-140351588748464_073393a9-014d-4444-881a-4e8f6bba0b97/test-curl-7767-140351588748464/0.log"
Sep 06 01:20:36.834223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.834195    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7767-140351588748464"]
Sep 06 01:20:36.835797 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.835778    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7767-140351588748464"]
Sep 06 01:20:36.862526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.862493    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4ptt\" (UniqueName: \"kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt\") pod \"073393a9-014d-4444-881a-4e8f6bba0b97\" (UID: \"073393a9-014d-4444-881a-4e8f6bba0b97\") "
Sep 06 01:20:36.862686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.862670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.862725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.862698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.862958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.862926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thvmn\" (UniqueName: \"kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.863385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.863363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.864849 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.864828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt" (OuterVolumeSpecName: "kube-api-access-x4ptt") pod "073393a9-014d-4444-881a-4e8f6bba0b97" (UID: "073393a9-014d-4444-881a-4e8f6bba0b97"). InnerVolumeSpecName "kube-api-access-x4ptt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:36.865272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.865255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.871980 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.871959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thvmn\" (UniqueName: \"kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn\") pod \"maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.943478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.943446    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:36.949117 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.949076    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7767-140351588748208"]
Sep 06 01:20:36.949517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.949499    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="073393a9-014d-4444-881a-4e8f6bba0b97" containerName="test-curl-7767-140351588748464"
Sep 06 01:20:36.949605 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.949520    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="073393a9-014d-4444-881a-4e8f6bba0b97" containerName="test-curl-7767-140351588748464"
Sep 06 01:20:36.949667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.949647    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="073393a9-014d-4444-881a-4e8f6bba0b97" containerName="test-curl-7767-140351588748464"
Sep 06 01:20:36.952771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.952749    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:36.959686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.959650    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7767-140351588748208"]
Sep 06 01:20:36.963554 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:36.963530    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4ptt\" (UniqueName: \"kubernetes.io/projected/073393a9-014d-4444-881a-4e8f6bba0b97-kube-api-access-x4ptt\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:20:37.064616 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.064581    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnkhh\" (UniqueName: \"kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh\") pod \"test-curl-7767-140351588748208\" (UID: \"2b3404a5-3332-4c25-b1fb-044600b2632f\") " pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:37.165418 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.165386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnkhh\" (UniqueName: \"kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh\") pod \"test-curl-7767-140351588748208\" (UID: \"2b3404a5-3332-4c25-b1fb-044600b2632f\") " pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:37.174806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.174776    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnkhh\" (UniqueName: \"kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh\") pod \"test-curl-7767-140351588748208\" (UID: \"2b3404a5-3332-4c25-b1fb-044600b2632f\") " pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:37.225591 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.225561    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:20:37.228073 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:37.228042    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a12c167_0bbb_43b9_97a0_753a4cb02f35.slice/crio-d6226771ee476e846fdad6027de80866db85b65be963cf0d7c8443699af62557 WatchSource:0}: Error finding container d6226771ee476e846fdad6027de80866db85b65be963cf0d7c8443699af62557: Status 404 returned error can't find the container with id d6226771ee476e846fdad6027de80866db85b65be963cf0d7c8443699af62557
Sep 06 01:20:37.272977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.272952    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:37.544904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.544877    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7767-140351588748208"]
Sep 06 01:20:37.547042 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:37.547018    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b3404a5_3332_4c25_b1fb_044600b2632f.slice/crio-9216c88651672b1b5be3ec7da27a3dd5b810e491234768606685be2f95927fc3 WatchSource:0}: Error finding container 9216c88651672b1b5be3ec7da27a3dd5b810e491234768606685be2f95927fc3: Status 404 returned error can't find the container with id 9216c88651672b1b5be3ec7da27a3dd5b810e491234768606685be2f95927fc3
Sep 06 01:20:37.643732 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.643699    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7767-140351588748208" event={"ID":"2b3404a5-3332-4c25-b1fb-044600b2632f","Type":"ContainerStarted","Data":"9216c88651672b1b5be3ec7da27a3dd5b810e491234768606685be2f95927fc3"}
Sep 06 01:20:37.645080 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.645049    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" event={"ID":"1a12c167-0bbb-43b9-97a0-753a4cb02f35","Type":"ContainerStarted","Data":"d6226771ee476e846fdad6027de80866db85b65be963cf0d7c8443699af62557"}
Sep 06 01:20:37.646428 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.646411    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78f9e09ed23043b5c652173595ca33e353e74809a1da607859f69274e3383849"
Sep 06 01:20:37.646512 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:37.646460    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:37.659630 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:37.659604    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7767-140351588748464\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="073393a9-014d-4444-881a-4e8f6bba0b97" pod="opendatahub/test-curl-7767-140351588748464"
Sep 06 01:20:38.163747 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.163709    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="073393a9-014d-4444-881a-4e8f6bba0b97" path="/var/lib/kubelet/pods/073393a9-014d-4444-881a-4e8f6bba0b97/volumes"
Sep 06 01:20:38.605966 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.605936    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:20:38.609639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.609617    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.613661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.613631    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-267e7071-openshift-default-dockercfg-hm5c4\""
Sep 06 01:20:38.637890 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.637864    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:20:38.661889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.661850    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" event={"ID":"1a12c167-0bbb-43b9-97a0-753a4cb02f35","Type":"ContainerStarted","Data":"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"}
Sep 06 01:20:38.662284 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.662018    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:38.702746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.702700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" podStartSLOduration=2.282885292 podStartE2EDuration="2.702687635s" totalImagesPullingTime="419.802343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:38.700420095 +0000 UTC m=+707.025840072" watchObservedRunningTime="2026-09-06 01:20:38.702687635 +0000 UTC m=+707.028107613"
Sep 06 01:20:38.781356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781361    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781565 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781466    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781571    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781592    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781821 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.781917 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.781881    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9q6m\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882764    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882809    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9q6m\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.882944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.882874    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.883310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.883018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.883310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.883035    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.883310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.883152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.883456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.883366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.883994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.883970    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.885249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.885225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.885490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.885474    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.891019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.890994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.891019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.891002    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9q6m\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m\") pod \"e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") " pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:38.921177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:38.921147    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:39.199580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.199556    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:20:39.201306 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:39.201282    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda825e826_7220_4525_9f04_e1169e2f5051.slice/crio-454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c WatchSource:0}: Error finding container 454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c: Status 404 returned error can't find the container with id 454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c
Sep 06 01:20:39.204792 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.204761    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:39.204866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.204827    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:39.204866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.204858    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:39.668218 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.668137    2557 generic.go:356] "Generic (PLEG): container finished" podID="2b3404a5-3332-4c25-b1fb-044600b2632f" containerID="2675567c20996a5a3c74e4a652c65b92bd3c07a0d20473436e8264f44126693f" exitCode=0
Sep 06 01:20:39.668595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.668223    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7767-140351588748208" event={"ID":"2b3404a5-3332-4c25-b1fb-044600b2632f","Type":"ContainerDied","Data":"2675567c20996a5a3c74e4a652c65b92bd3c07a0d20473436e8264f44126693f"}
Sep 06 01:20:39.670028 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.670000    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerStarted","Data":"84abb2da8990562becc7d0ec1b184717b05f1bedcc29be0160420e839d52123e"}
Sep 06 01:20:39.670186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.670045    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerStarted","Data":"454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c"}
Sep 06 01:20:39.701399 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.701345    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podStartSLOduration=1.7013294939999999 podStartE2EDuration="1.701329494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:39.698976836 +0000 UTC m=+708.024396822" watchObservedRunningTime="2026-09-06 01:20:39.701329494 +0000 UTC m=+708.026749470"
Sep 06 01:20:39.921874 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:39.921775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:40.814620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:40.814582    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:40.837511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:40.837476    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7767-140351588748208_2b3404a5-3332-4c25-b1fb-044600b2632f/test-curl-7767-140351588748208/0.log"
Sep 06 01:20:40.879390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:40.879348    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7767-140351588748208"]
Sep 06 01:20:40.889672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:40.889631    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7767-140351588748208"]
Sep 06 01:20:40.927883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:40.927788    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:41.001143 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.001085    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnkhh\" (UniqueName: \"kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh\") pod \"2b3404a5-3332-4c25-b1fb-044600b2632f\" (UID: \"2b3404a5-3332-4c25-b1fb-044600b2632f\") "
Sep 06 01:20:41.003313 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.003280    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh" (OuterVolumeSpecName: "kube-api-access-hnkhh") pod "2b3404a5-3332-4c25-b1fb-044600b2632f" (UID: "2b3404a5-3332-4c25-b1fb-044600b2632f"). InnerVolumeSpecName "kube-api-access-hnkhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:20:41.102253 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.102212    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnkhh\" (UniqueName: \"kubernetes.io/projected/2b3404a5-3332-4c25-b1fb-044600b2632f-kube-api-access-hnkhh\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:20:41.682815 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.682779    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:41.682815 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.682810    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9216c88651672b1b5be3ec7da27a3dd5b810e491234768606685be2f95927fc3"
Sep 06 01:20:41.683283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.683243    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:41.684041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:41.684021    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:41.707805 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:41.707763    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7767-140351588748208\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:42.163074 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:42.163038    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7767-140351588748208\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" pod="opendatahub/test-curl-7767-140351588748208"
Sep 06 01:20:42.165020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.164991    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" path="/var/lib/kubelet/pods/2b3404a5-3332-4c25-b1fb-044600b2632f/volumes"
Sep 06 01:20:42.165424 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.165402    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:20:42.166002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.165981    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" containerName="test-curl-7767-140351588748208"
Sep 06 01:20:42.166076 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.166006    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" containerName="test-curl-7767-140351588748208"
Sep 06 01:20:42.166152 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.166137    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3404a5-3332-4c25-b1fb-044600b2632f" containerName="test-curl-7767-140351588748208"
Sep 06 01:20:42.169805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.169775    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.172912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.172890    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-267e7071-serving-cert\""
Sep 06 01:20:42.188347 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.188311    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:20:42.314714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.314680    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.314911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.314762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpdns\" (UniqueName: \"kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.314911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.314898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.415857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.415768    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpdns\" (UniqueName: \"kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.415857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.415832    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.416058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.415877    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.416630 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.416603    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.418363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.418344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.430982 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.430958    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpdns\" (UniqueName: \"kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns\") pod \"maas-api-e2e-ait-267e7071-566749675-w7ktq\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.484328 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.484288    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:42.761824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.761770    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:20:42.773386 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:42.773266    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c800af3_f330_41f7_999d_2ac615b03f17.slice/crio-fa335bacd684231c7469f384fd83ca064477f91e5d402b7b648385e09e6ffba6 WatchSource:0}: Error finding container fa335bacd684231c7469f384fd83ca064477f91e5d402b7b648385e09e6ffba6: Status 404 returned error can't find the container with id fa335bacd684231c7469f384fd83ca064477f91e5d402b7b648385e09e6ffba6
Sep 06 01:20:42.948125 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.947498    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:20:42.954024 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.953230    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:42.956410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.956378    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-267e7071\""
Sep 06 01:20:42.972340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:42.972299    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:20:43.122084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.122034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.122285 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.122149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kpn2\" (UniqueName: \"kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.223519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.223483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.223978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.223542    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kpn2\" (UniqueName: \"kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.224378 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.224353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.231830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.231808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kpn2\" (UniqueName: \"kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2\") pod \"payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.282868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.282817    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.563124 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:43.563056    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d9db3c_6b81_400e_aa09_13d09fbda32c.slice/crio-90b320e657d4f3656de36204cc3377fc81340707d1e8ae01dcf925a8f98761d5 WatchSource:0}: Error finding container 90b320e657d4f3656de36204cc3377fc81340707d1e8ae01dcf925a8f98761d5: Status 404 returned error can't find the container with id 90b320e657d4f3656de36204cc3377fc81340707d1e8ae01dcf925a8f98761d5
Sep 06 01:20:43.563278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.563157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:20:43.697135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.697079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" event={"ID":"74d9db3c-6b81-400e-aa09-13d09fbda32c","Type":"ContainerStarted","Data":"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"}
Sep 06 01:20:43.697323 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.697167    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" event={"ID":"74d9db3c-6b81-400e-aa09-13d09fbda32c","Type":"ContainerStarted","Data":"90b320e657d4f3656de36204cc3377fc81340707d1e8ae01dcf925a8f98761d5"}
Sep 06 01:20:43.697323 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.697217    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:43.699041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.698956    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" event={"ID":"6c800af3-f330-41f7-999d-2ac615b03f17","Type":"ContainerStarted","Data":"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"}
Sep 06 01:20:43.699041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.699010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" event={"ID":"6c800af3-f330-41f7-999d-2ac615b03f17","Type":"ContainerStarted","Data":"fa335bacd684231c7469f384fd83ca064477f91e5d402b7b648385e09e6ffba6"}
Sep 06 01:20:43.713243 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.713175    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" podStartSLOduration=1.7131547280000001 podStartE2EDuration="1.713154728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:43.712324682 +0000 UTC m=+712.037744654" watchObservedRunningTime="2026-09-06 01:20:43.713154728 +0000 UTC m=+712.038574706"
Sep 06 01:20:43.730476 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:43.730430    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" podStartSLOduration=1.436207147 podStartE2EDuration="1.730413588s" totalImagesPullingTime="294.206441ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:43.729346377 +0000 UTC m=+712.054766355" watchObservedRunningTime="2026-09-06 01:20:43.730413588 +0000 UTC m=+712.055833567"
Sep 06 01:20:44.675962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:44.675877    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:20:44.704231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:44.704199    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:46.246886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.246849    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:20:46.251990 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.251954    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.255937 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.255904    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-20c535-serving-cert\""
Sep 06 01:20:46.262416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.262374    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:20:46.361127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.357653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.361127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.357857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqc4f\" (UniqueName: \"kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.361127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.357932    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.458596 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.458548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqc4f\" (UniqueName: \"kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.458804 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.458628    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.458804 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.458700    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.458940 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:46.458867    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-20c535-serving-cert: secret "maas-api-e2e-autores-20c535-serving-cert" not found
Sep 06 01:20:46.458999 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:20:46.458962    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls podName:df74808e-ad4a-4501-ba32-a40290549c06 nodeName:}" failed. No retries permitted until 2026-09-06 01:20:46.958941313 +0000 UTC m=+715.284361269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls") pod "maas-api-e2e-autores-20c535-7597ff6869-7gmdb" (UID: "df74808e-ad4a-4501-ba32-a40290549c06") : secret "maas-api-e2e-autores-20c535-serving-cert" not found
Sep 06 01:20:46.460181 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.460150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.471133 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.470715    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqc4f\" (UniqueName: \"kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.968335 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.967598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:46.977214 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:46.976898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") pod \"maas-api-e2e-autores-20c535-7597ff6869-7gmdb\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:47.009445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.009417    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:20:47.017515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.017477    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.020478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.020452    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-20c535\""
Sep 06 01:20:47.020721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.020646    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-20c535-dockercfg-smftl\""
Sep 06 01:20:47.026295 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.026267    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:20:47.075127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.074845    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.075127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.075040    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc94c\" (UniqueName: \"kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.171128 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.170925    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:47.180230 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.180181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc94c\" (UniqueName: \"kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.180387 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.180368    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.181363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.181333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.194486 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.194423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc94c\" (UniqueName: \"kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c\") pod \"payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.330120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.330052    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:47.489140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.480870    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:20:47.649356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.649309    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:20:47.659918 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:20:47.659889    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f05a91_3b8c_44e8_a3fb_89125bf0c91c.slice/crio-11c24b3e0a24c32770b5df5fde515a41e31e93966c39b78df4d911ce8e56b05b WatchSource:0}: Error finding container 11c24b3e0a24c32770b5df5fde515a41e31e93966c39b78df4d911ce8e56b05b: Status 404 returned error can't find the container with id 11c24b3e0a24c32770b5df5fde515a41e31e93966c39b78df4d911ce8e56b05b
Sep 06 01:20:47.721298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.721259    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" event={"ID":"df74808e-ad4a-4501-ba32-a40290549c06","Type":"ContainerStarted","Data":"5bc62b2cf5e0ea654fe071eb32158704bd982f7d1a08101f85d8ea79f383e7d5"}
Sep 06 01:20:47.722951 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:47.722919    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" event={"ID":"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c","Type":"ContainerStarted","Data":"11c24b3e0a24c32770b5df5fde515a41e31e93966c39b78df4d911ce8e56b05b"}
Sep 06 01:20:48.731020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.730976    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" event={"ID":"df74808e-ad4a-4501-ba32-a40290549c06","Type":"ContainerStarted","Data":"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"}
Sep 06 01:20:48.731506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.731059    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:48.732859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.732828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" event={"ID":"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c","Type":"ContainerStarted","Data":"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"}
Sep 06 01:20:48.733000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.732892    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:48.749881 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.749825    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" podStartSLOduration=2.422067006 podStartE2EDuration="2.749803384s" totalImagesPullingTime="327.736378ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:48.747877837 +0000 UTC m=+717.073297815" watchObservedRunningTime="2026-09-06 01:20:48.749803384 +0000 UTC m=+717.075223365"
Sep 06 01:20:48.763601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:48.763549    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" podStartSLOduration=2.763531553 podStartE2EDuration="2.763531553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:20:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:20:48.762218895 +0000 UTC m=+717.087638872" watchObservedRunningTime="2026-09-06 01:20:48.763531553 +0000 UTC m=+717.088951530"
Sep 06 01:20:50.664344 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:50.664302    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 01:20:50.665010 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:50.664980    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:20:50.714818 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:50.714790    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:20:51.755179 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.755138    2557 generic.go:356] "Generic (PLEG): container finished" podID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerID="7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a" exitCode=0
Sep 06 01:20:51.755726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.755196    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerDied","Data":"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"}
Sep 06 01:20:51.755726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.755662    2557 scope.go:117] "RemoveContainer" containerID="7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"
Sep 06 01:20:51.759425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.758496    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:51.759425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.758590    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:51.759425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:51.758638    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:52.766902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:52.766851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerStarted","Data":"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"}
Sep 06 01:20:53.261817 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:53.261769    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:53.262044 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:53.261914    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 06 01:20:53.262044 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:53.261960    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 06 01:20:54.262214 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:54.262167    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 06 01:20:54.262737 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:54.262239    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 06 01:20:54.706542 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:54.706513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:20:54.762123 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:54.750470    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:20:55.261475 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:55.261436    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 06 01:20:55.261739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:55.261712    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 06 01:20:56.261710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:56.261666    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 06 01:20:56.262716 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:56.262283    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 06 01:20:57.261674 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:57.261635    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 06 01:20:57.261934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:57.261908    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 06 01:20:57.724262 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:57.724224    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 01:20:57.724497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:57.724475    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:20:58.264969 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.264931    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:58.265507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.265477    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:58.266461 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.266436    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:20:58.809529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.809500    2557 generic.go:356] "Generic (PLEG): container finished" podID="a825e826-7220-4525-9f04-e1169e2f5051" containerID="84abb2da8990562becc7d0ec1b184717b05f1bedcc29be0160420e839d52123e" exitCode=0
Sep 06 01:20:58.809747 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.809574    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerDied","Data":"84abb2da8990562becc7d0ec1b184717b05f1bedcc29be0160420e839d52123e"}
Sep 06 01:20:58.810112 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.810082    2557 scope.go:117] "RemoveContainer" containerID="84abb2da8990562becc7d0ec1b184717b05f1bedcc29be0160420e839d52123e"
Sep 06 01:20:58.811118 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.811080    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:58.811220 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.811188    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:58.811287 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:58.811241    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:20:59.740314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:59.740282    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:20:59.818816 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:59.818781    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerStarted","Data":"52338302bdaabd826c8930993a17d27235ecd24fa638fec2492745ee1771b31d"}
Sep 06 01:20:59.921652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:59.921616    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:20:59.921828 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:59.921806    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:20:59.921885 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:20:59.921866    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:00.921767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:00.921722    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:21:00.922182 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:00.921787    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:01.006334 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.006302    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:21:01.009837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.009811    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.012257 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.012238    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-4b217a-openshift-default-dockercfg-xd4vm\""
Sep 06 01:21:01.027060 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.027036    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:21:01.136860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.136823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.136907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrkb\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.136942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.136962    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.136982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.137008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137274 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.137038    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137274 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.137060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.137274 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.137085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238205 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238210    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238329    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrkb\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238493    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238508    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238527    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238788 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238788 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238763    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238909    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.238989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238961    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.239026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.238985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.239328 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.239305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.244356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.244330    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.250786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.250753    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.253055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.253024    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrkb\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.260511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.260471    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo\") pod \"e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") " pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.324426 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.324391    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:01.626655 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.626630    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:21:01.628853 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:21:01.628824    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode274de59_4d65_4259_82a3_97db8857521a.slice/crio-5c2fa32a06a32947399d92fbc7661b68ac06bef334449205cc7881094f5843f7 WatchSource:0}: Error finding container 5c2fa32a06a32947399d92fbc7661b68ac06bef334449205cc7881094f5843f7: Status 404 returned error can't find the container with id 5c2fa32a06a32947399d92fbc7661b68ac06bef334449205cc7881094f5843f7
Sep 06 01:21:01.631295 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.631251    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:01.631375 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.631348    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:01.631411 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.631393    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:01.831809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.831777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerStarted","Data":"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"}
Sep 06 01:21:01.831981 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.831827    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerStarted","Data":"5c2fa32a06a32947399d92fbc7661b68ac06bef334449205cc7881094f5843f7"}
Sep 06 01:21:01.855516 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.855456    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podStartSLOduration=1.8554359809999998 podStartE2EDuration="1.855435981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:01.853714773 +0000 UTC m=+730.179134751" watchObservedRunningTime="2026-09-06 01:21:01.855435981 +0000 UTC m=+730.180855959"
Sep 06 01:21:01.921592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.921505    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:21:01.921755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:01.921580    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:02.325297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.325267    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:02.331866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.331830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:02.836982 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.836950    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:02.837871 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.837843    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:02.921943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.921902    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:21:02.922157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:02.921961    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:03.921745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:03.921707    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:21:03.922247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:03.921758    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:04.921837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:04.921795    2557 patch_prober.go:28] interesting pod/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Sep 06 01:21:04.922269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:04.921856    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Sep 06 01:21:05.044892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.044854    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:21:05.049298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.049272    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.051749 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.051723    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-4b217a-serving-cert\""
Sep 06 01:21:05.064297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.064262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:21:05.201526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.201489    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.201704 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.201626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.201771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.201745    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlnw2\" (UniqueName: \"kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.302506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.302472    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.302703 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.302541    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlnw2\" (UniqueName: \"kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.302703 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.302583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.302703 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:05.302667    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-serving-cert: secret "maas-api-e2e-inf-b-4b217a-serving-cert" not found
Sep 06 01:21:05.302890 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:05.302731    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls podName:15fa17e3-c289-43d7-b2c0-3c4db19be9da nodeName:}" failed. No retries permitted until 2026-09-06 01:21:05.802714512 +0000 UTC m=+734.128134467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls") pod "maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" (UID: "15fa17e3-c289-43d7-b2c0-3c4db19be9da") : secret "maas-api-e2e-inf-b-4b217a-serving-cert" not found
Sep 06 01:21:05.303235 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.303208    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.311600 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.311577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlnw2\" (UniqueName: \"kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.806981 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.806938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.809456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.809418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:05.925373 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.925339    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:21:05.925869 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.925849    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:21:05.926496 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.926480    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:21:05.969222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:05.969189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:06.249905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:06.249876    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:21:06.250781 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:21:06.250754    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fa17e3_c289_43d7_b2c0_3c4db19be9da.slice/crio-9c8da41a93f9609db7034789a8569c3fc75ab35c65c7e12929b418ba78bafb61 WatchSource:0}: Error finding container 9c8da41a93f9609db7034789a8569c3fc75ab35c65c7e12929b418ba78bafb61: Status 404 returned error can't find the container with id 9c8da41a93f9609db7034789a8569c3fc75ab35c65c7e12929b418ba78bafb61
Sep 06 01:21:06.881020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:06.880985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" event={"ID":"15fa17e3-c289-43d7-b2c0-3c4db19be9da","Type":"ContainerStarted","Data":"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"}
Sep 06 01:21:06.881191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:06.881045    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" event={"ID":"15fa17e3-c289-43d7-b2c0-3c4db19be9da","Type":"ContainerStarted","Data":"9c8da41a93f9609db7034789a8569c3fc75ab35c65c7e12929b418ba78bafb61"}
Sep 06 01:21:06.881257 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:06.881228    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:06.901197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:06.901149    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" podStartSLOduration=1.474757883 podStartE2EDuration="1.901134517s" totalImagesPullingTime="426.376634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:06.899519985 +0000 UTC m=+735.224939962" watchObservedRunningTime="2026-09-06 01:21:06.901134517 +0000 UTC m=+735.226554495"
Sep 06 01:21:12.891974 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:12.891938    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:21:23.360995 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.360947    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:21:23.361495 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.361269    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" podUID="6c800af3-f330-41f7-999d-2ac615b03f17" containerName="maas-api" containerID="cri-o://3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94" gracePeriod=30
Sep 06 01:21:23.440038 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.440003    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:21:23.444127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.440265    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" podUID="74d9db3c-6b81-400e-aa09-13d09fbda32c" containerName="payload-pre-processing" containerID="cri-o://65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf" gracePeriod=30
Sep 06 01:21:23.667433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.667375    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:21:23.688487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.688454    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca\") pod \"6c800af3-f330-41f7-999d-2ac615b03f17\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") "
Sep 06 01:21:23.688675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.688541    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls\") pod \"6c800af3-f330-41f7-999d-2ac615b03f17\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") "
Sep 06 01:21:23.688675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.688607    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpdns\" (UniqueName: \"kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns\") pod \"6c800af3-f330-41f7-999d-2ac615b03f17\" (UID: \"6c800af3-f330-41f7-999d-2ac615b03f17\") "
Sep 06 01:21:23.689563 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.689286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c800af3-f330-41f7-999d-2ac615b03f17" (UID: "6c800af3-f330-41f7-999d-2ac615b03f17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:23.702886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.702830    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c800af3-f330-41f7-999d-2ac615b03f17" (UID: "6c800af3-f330-41f7-999d-2ac615b03f17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:21:23.709944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.709698    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns" (OuterVolumeSpecName: "kube-api-access-kpdns") pod "6c800af3-f330-41f7-999d-2ac615b03f17" (UID: "6c800af3-f330-41f7-999d-2ac615b03f17"). InnerVolumeSpecName "kube-api-access-kpdns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:23.717895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.717868    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:21:23.718356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.718135    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy" containerID="cri-o://52338302bdaabd826c8930993a17d27235ecd24fa638fec2492745ee1771b31d" gracePeriod=30
Sep 06 01:21:23.789772 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.789739    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpdns\" (UniqueName: \"kubernetes.io/projected/6c800af3-f330-41f7-999d-2ac615b03f17-kube-api-access-kpdns\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.789886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.789773    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c800af3-f330-41f7-999d-2ac615b03f17-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.789886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.789791    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c800af3-f330-41f7-999d-2ac615b03f17-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.793359 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.793336    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:21:23.890965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.890930    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume\") pod \"74d9db3c-6b81-400e-aa09-13d09fbda32c\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") "
Sep 06 01:21:23.891207 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.891059    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kpn2\" (UniqueName: \"kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2\") pod \"74d9db3c-6b81-400e-aa09-13d09fbda32c\" (UID: \"74d9db3c-6b81-400e-aa09-13d09fbda32c\") "
Sep 06 01:21:23.891429 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.891404    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74d9db3c-6b81-400e-aa09-13d09fbda32c" (UID: "74d9db3c-6b81-400e-aa09-13d09fbda32c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:23.893117 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.893078    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2" (OuterVolumeSpecName: "kube-api-access-9kpn2") pod "74d9db3c-6b81-400e-aa09-13d09fbda32c" (UID: "74d9db3c-6b81-400e-aa09-13d09fbda32c"). InnerVolumeSpecName "kube-api-access-9kpn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:23.983353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.983316    2557 generic.go:356] "Generic (PLEG): container finished" podID="74d9db3c-6b81-400e-aa09-13d09fbda32c" containerID="65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf" exitCode=0
Sep 06 01:21:23.983530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.983363    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"
Sep 06 01:21:23.983530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.983393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" event={"ID":"74d9db3c-6b81-400e-aa09-13d09fbda32c","Type":"ContainerDied","Data":"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"}
Sep 06 01:21:23.983530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.983448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2" event={"ID":"74d9db3c-6b81-400e-aa09-13d09fbda32c","Type":"ContainerDied","Data":"90b320e657d4f3656de36204cc3377fc81340707d1e8ae01dcf925a8f98761d5"}
Sep 06 01:21:23.983530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.983476    2557 scope.go:117] "RemoveContainer" containerID="65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"
Sep 06 01:21:23.984888 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.984868    2557 generic.go:356] "Generic (PLEG): container finished" podID="6c800af3-f330-41f7-999d-2ac615b03f17" containerID="3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94" exitCode=0
Sep 06 01:21:23.985004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.984935    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"
Sep 06 01:21:23.985004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.984938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" event={"ID":"6c800af3-f330-41f7-999d-2ac615b03f17","Type":"ContainerDied","Data":"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"}
Sep 06 01:21:23.985141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.985046    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq" event={"ID":"6c800af3-f330-41f7-999d-2ac615b03f17","Type":"ContainerDied","Data":"fa335bacd684231c7469f384fd83ca064477f91e5d402b7b648385e09e6ffba6"}
Sep 06 01:21:23.991941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.991918    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74d9db3c-6b81-400e-aa09-13d09fbda32c-plugins-config-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.991941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.991941    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kpn2\" (UniqueName: \"kubernetes.io/projected/74d9db3c-6b81-400e-aa09-13d09fbda32c-kube-api-access-9kpn2\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:23.995365 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.995344    2557 scope.go:117] "RemoveContainer" containerID="65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"
Sep 06 01:21:23.995727 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:23.995692    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf\": container with ID starting with 65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf not found: ID does not exist" containerID="65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"
Sep 06 01:21:23.995835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.995739    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf"} err="failed to get container status \"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf\": rpc error: code = NotFound desc = could not find container \"65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf\": container with ID starting with 65c7fb0c6e5d0119f5cf4c6beab847fb9e6fa6f65bd2b6cabb8a7082a6a24cbf not found: ID does not exist"
Sep 06 01:21:23.995835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:23.995763    2557 scope.go:117] "RemoveContainer" containerID="3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"
Sep 06 01:21:24.007249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.007227    2557 scope.go:117] "RemoveContainer" containerID="3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"
Sep 06 01:21:24.007650 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:24.007573    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94\": container with ID starting with 3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94 not found: ID does not exist" containerID="3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"
Sep 06 01:21:24.007650 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.007613    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94"} err="failed to get container status \"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94\": rpc error: code = NotFound desc = could not find container \"3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94\": container with ID starting with 3b737f5841e24b45eb6e73b3019144b3e930a3e6d9aaa204c7a79b650e67ed94 not found: ID does not exist"
Sep 06 01:21:24.011883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.011861    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:21:24.016384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.016364    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-267e7071-5bd49c586b-7f6s2"]
Sep 06 01:21:24.026879 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.026847    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:21:24.028910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.028888    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-267e7071-566749675-w7ktq"]
Sep 06 01:21:24.165000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.164965    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c800af3-f330-41f7-999d-2ac615b03f17" path="/var/lib/kubelet/pods/6c800af3-f330-41f7-999d-2ac615b03f17/volumes"
Sep 06 01:21:24.165395 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.165380    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74d9db3c-6b81-400e-aa09-13d09fbda32c" path="/var/lib/kubelet/pods/74d9db3c-6b81-400e-aa09-13d09fbda32c/volumes"
Sep 06 01:21:24.652976 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.652893    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:21:24.653603 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653580    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c800af3-f330-41f7-999d-2ac615b03f17" containerName="maas-api"
Sep 06 01:21:24.653654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653609    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c800af3-f330-41f7-999d-2ac615b03f17" containerName="maas-api"
Sep 06 01:21:24.653654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653640    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74d9db3c-6b81-400e-aa09-13d09fbda32c" containerName="payload-pre-processing"
Sep 06 01:21:24.653654 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653648    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74d9db3c-6b81-400e-aa09-13d09fbda32c" containerName="payload-pre-processing"
Sep 06 01:21:24.653771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653758    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="74d9db3c-6b81-400e-aa09-13d09fbda32c" containerName="payload-pre-processing"
Sep 06 01:21:24.653812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.653779    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c800af3-f330-41f7-999d-2ac615b03f17" containerName="maas-api"
Sep 06 01:21:24.658661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.658637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.661069 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.661046    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-52c53f94-gw-openshift-default-dockercfg-dmfcr\""
Sep 06 01:21:24.669561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.669087    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:21:24.698556 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698521    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v66q\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698772    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.698933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.698917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v66q\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800674    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.800715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.801092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800749    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.801092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.800773    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.801543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.801308    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.801543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.801390    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.803493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.801631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.803493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.801850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.803493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.801964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.803634 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.803560    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.803996 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.803977    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.809012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.808985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.809257 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.809237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v66q\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q\") pod \"e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") " pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:24.972588 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:24.972550    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:25.253844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:25.253817    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:21:25.255934 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:21:25.255904    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod255aabaf_0876_4c2d_bbd5_b09e9f14eee4.slice/crio-831f8933b70bac5bd5ed2266754168ec67fbfc12d100218dd02f223b16dbbbf4 WatchSource:0}: Error finding container 831f8933b70bac5bd5ed2266754168ec67fbfc12d100218dd02f223b16dbbbf4: Status 404 returned error can't find the container with id 831f8933b70bac5bd5ed2266754168ec67fbfc12d100218dd02f223b16dbbbf4
Sep 06 01:21:25.258258 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:25.258223    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:25.258351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:25.258300    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:25.258351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:25.258341    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:26.001380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:26.001345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerStarted","Data":"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"}
Sep 06 01:21:26.001756 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:26.001410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerStarted","Data":"831f8933b70bac5bd5ed2266754168ec67fbfc12d100218dd02f223b16dbbbf4"}
Sep 06 01:21:26.973162 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:26.973124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:26.978459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:26.978434    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:27.002145 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.002079    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podStartSLOduration=3.002063206 podStartE2EDuration="3.002063206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:26.027299757 +0000 UTC m=+754.352719737" watchObservedRunningTime="2026-09-06 01:21:27.002063206 +0000 UTC m=+755.327483183"
Sep 06 01:21:27.009161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.009131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerDied","Data":"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"}
Sep 06 01:21:27.009302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.009130    2557 generic.go:356] "Generic (PLEG): container finished" podID="e274de59-4d65-4259-82a3-97db8857521a" containerID="d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa" exitCode=0
Sep 06 01:21:27.009573 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.009556    2557 scope.go:117] "RemoveContainer" containerID="d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"
Sep 06 01:21:27.009640 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.009624    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:27.010648 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.010627    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:27.010840 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.010808    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:27.010909 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.010893    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:27.010955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.010941    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:27.598503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.598463    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:21:27.602117 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.602086    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.604485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.604467    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-52c53f94-serving-cert\""
Sep 06 01:21:27.611584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.611559    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:21:27.625611 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.625583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.625736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.625707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.625805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.625787    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t986g\" (UniqueName: \"kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.727293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.727259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t986g\" (UniqueName: \"kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.727481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.727370    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.727481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.727398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.727602 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:27.727523    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-serving-cert: secret "maas-api-e2e-migrate-52c53f94-serving-cert" not found
Sep 06 01:21:27.727662 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:21:27.727603    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls podName:6ab71cfa-9fe6-4a45-bc3e-47f021eedb31 nodeName:}" failed. No retries permitted until 2026-09-06 01:21:28.227581306 +0000 UTC m=+756.553001264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls") pod "maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" (UID: "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31") : secret "maas-api-e2e-migrate-52c53f94-serving-cert" not found
Sep 06 01:21:27.728059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.728040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:27.736538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:27.736514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t986g\" (UniqueName: \"kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:28.016784 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.016746    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerStarted","Data":"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"}
Sep 06 01:21:28.232637 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.232605    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:28.235501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.235469    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") pod \"maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:28.325463 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.325390    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:28.326444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.326407    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:28.326579 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.326467    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:28.514566 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.514534    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:28.817520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:28.817490    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:21:28.831149 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:21:28.831120    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab71cfa_9fe6_4a45_bc3e_47f021eedb31.slice/crio-2af3038076054b73e24272fc7102f67723bc69967a87c029558f0a0b5362ed72 WatchSource:0}: Error finding container 2af3038076054b73e24272fc7102f67723bc69967a87c029558f0a0b5362ed72: Status 404 returned error can't find the container with id 2af3038076054b73e24272fc7102f67723bc69967a87c029558f0a0b5362ed72
Sep 06 01:21:29.024145 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.024079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" event={"ID":"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31","Type":"ContainerStarted","Data":"2af3038076054b73e24272fc7102f67723bc69967a87c029558f0a0b5362ed72"}
Sep 06 01:21:29.026061 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.026032    2557 generic.go:356] "Generic (PLEG): container finished" podID="a825e826-7220-4525-9f04-e1169e2f5051" containerID="52338302bdaabd826c8930993a17d27235ecd24fa638fec2492745ee1771b31d" exitCode=0
Sep 06 01:21:29.026200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.026125    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerDied","Data":"52338302bdaabd826c8930993a17d27235ecd24fa638fec2492745ee1771b31d"}
Sep 06 01:21:29.026200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.026183    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq" event={"ID":"a825e826-7220-4525-9f04-e1169e2f5051","Type":"ContainerDied","Data":"454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c"}
Sep 06 01:21:29.026325 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.026212    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="454584e7ae0a74a10e53b6b5695fc76c802a213a67bec85a76f3f58cee62ce2c"
Sep 06 01:21:29.026325 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.026232    2557 scope.go:117] "RemoveContainer" containerID="84abb2da8990562becc7d0ec1b184717b05f1bedcc29be0160420e839d52123e"
Sep 06 01:21:29.029606 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.029584    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141356    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141431    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141505    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141562    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9q6m\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141595    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141625    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141650    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141697    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.141746    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo\") pod \"a825e826-7220-4525-9f04-e1169e2f5051\" (UID: \"a825e826-7220-4525-9f04-e1169e2f5051\") "
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.142607    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.142828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.143004    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:21:29.144176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.143907    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:29.144970 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.144326    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data" (OuterVolumeSpecName: "istio-data") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:21:29.152230 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.152201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:21:29.152467 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.152446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m" (OuterVolumeSpecName: "kube-api-access-c9q6m") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "kube-api-access-c9q6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:29.160405 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.160379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:21:29.167503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.167475    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token" (OuterVolumeSpecName: "istio-token") pod "a825e826-7220-4525-9f04-e1169e2f5051" (UID: "a825e826-7220-4525-9f04-e1169e2f5051"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244711    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a825e826-7220-4525-9f04-e1169e2f5051-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244746    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244761    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244778    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244794    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9q6m\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-kube-api-access-c9q6m\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244808    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a825e826-7220-4525-9f04-e1169e2f5051-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244821    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244832    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a825e826-7220-4525-9f04-e1169e2f5051-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.248137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.244843    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a825e826-7220-4525-9f04-e1169e2f5051-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:21:29.324839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.324805    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:29.324998 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:29.324857    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:30.039652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.039620    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"
Sep 06 01:21:30.049223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.049180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" event={"ID":"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31","Type":"ContainerStarted","Data":"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"}
Sep 06 01:21:30.049874 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.049845    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:30.101585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.101528    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" podStartSLOduration=2.737570905 podStartE2EDuration="3.101485216s" totalImagesPullingTime="363.914311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:30.10058907 +0000 UTC m=+758.426009048" watchObservedRunningTime="2026-09-06 01:21:30.101485216 +0000 UTC m=+758.426905194"
Sep 06 01:21:30.115906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.115874    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:21:30.119768 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.119742    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-267e7071-openshift-default-569b5cfb9d-8g6tq"]
Sep 06 01:21:30.169551 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.169512    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a825e826-7220-4525-9f04-e1169e2f5051" path="/var/lib/kubelet/pods/a825e826-7220-4525-9f04-e1169e2f5051/volumes"
Sep 06 01:21:30.325082 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.324994    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:30.325082 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:30.325052    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:31.325343 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:31.325302    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:31.325742 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:31.325362    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:32.325766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:32.325728    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:32.326217 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:32.325787    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:32.837420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:32.837365    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:33.325409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:33.325372    2557 patch_prober.go:28] interesting pod/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 06 01:21:33.325592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:33.325428    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 06 01:21:34.329786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:34.329747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:34.330766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:34.330742    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:21:37.073679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:37.073645    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:21:49.178288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.178181    2557 generic.go:356] "Generic (PLEG): container finished" podID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerID="a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b" exitCode=0
Sep 06 01:21:49.178288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.178261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerDied","Data":"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"}
Sep 06 01:21:49.178849 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.178749    2557 scope.go:117] "RemoveContainer" containerID="a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"
Sep 06 01:21:49.179973 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.179942    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:49.180054 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.180023    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:49.180095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:49.180058    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:21:50.185767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:50.185725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerStarted","Data":"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"}
Sep 06 01:21:50.972886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:50.972845    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:50.973086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:50.973052    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 01:21:50.973197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:50.973142    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 01:21:51.973030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:51.972986    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 01:21:51.973478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:51.973053    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 01:21:52.442695 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.442662    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"]
Sep 06 01:21:52.443537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.443513    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.443675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.443664    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.443765 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.443756    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.443839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.443831    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.444014 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.444003    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.444121 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.444094    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a825e826-7220-4525-9f04-e1169e2f5051" containerName="istio-proxy"
Sep 06 01:21:52.451767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.451746    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:52.453180 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.452975    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"]
Sep 06 01:21:52.454812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.454788    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:21:52.484280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.484244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf\" (UID: \"87fc557e-957a-4b4b-b558-d6f5cc66d3c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:52.585628 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.585587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf\" (UID: \"87fc557e-957a-4b4b-b558-d6f5cc66d3c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:52.586342 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.586310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf\" (UID: \"87fc557e-957a-4b4b-b558-d6f5cc66d3c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:52.769858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.769768    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:52.973624 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.973582    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 01:21:52.973998 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:52.973644    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 01:21:53.046180 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:53.042983    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"]
Sep 06 01:21:53.206646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:53.206612    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf" event={"ID":"87fc557e-957a-4b4b-b558-d6f5cc66d3c3","Type":"ContainerStarted","Data":"b2938e534171b72ed3c00ee1a6e808167d0116cfd3d8dfd474d77c190b149597"}
Sep 06 01:21:53.973069 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:53.973034    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 01:21:53.973271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:53.973092    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 01:21:54.973356 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:54.973313    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 01:21:54.973839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:54.973380    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 01:21:55.977984 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:55.977954    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:55.978462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:55.978397    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:55.979086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:55.979065    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:21:57.230577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:57.230544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf" event={"ID":"87fc557e-957a-4b4b-b558-d6f5cc66d3c3","Type":"ContainerStarted","Data":"ba0e08697ae8982843999c7053a2eef50955f2ec32a588ac32c94eec22625497"}
Sep 06 01:21:57.245341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:57.245296    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf" podStartSLOduration=1.541748444 podStartE2EDuration="5.245281491s" totalImagesPullingTime="3.703533047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:21:57.244829156 +0000 UTC m=+785.570249133" watchObservedRunningTime="2026-09-06 01:21:57.245281491 +0000 UTC m=+785.570701468"
Sep 06 01:21:58.237357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:58.237326    2557 generic.go:356] "Generic (PLEG): container finished" podID="87fc557e-957a-4b4b-b558-d6f5cc66d3c3" containerID="ba0e08697ae8982843999c7053a2eef50955f2ec32a588ac32c94eec22625497" exitCode=0
Sep 06 01:21:58.237923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:58.237412    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf" event={"ID":"87fc557e-957a-4b4b-b558-d6f5cc66d3c3","Type":"ContainerDied","Data":"ba0e08697ae8982843999c7053a2eef50955f2ec32a588ac32c94eec22625497"}
Sep 06 01:21:59.390965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:59.390937    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:21:59.448007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:59.447977    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca\") pod \"87fc557e-957a-4b4b-b558-d6f5cc66d3c3\" (UID: \"87fc557e-957a-4b4b-b558-d6f5cc66d3c3\") "
Sep 06 01:21:59.448419 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:59.448394    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87fc557e-957a-4b4b-b558-d6f5cc66d3c3" (UID: "87fc557e-957a-4b4b-b558-d6f5cc66d3c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:21:59.549017 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:21:59.548938    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87fc557e-957a-4b4b-b558-d6f5cc66d3c3-maas-api-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:00.251980 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:00.251950    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"
Sep 06 01:22:00.252150 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:00.251985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf" event={"ID":"87fc557e-957a-4b4b-b558-d6f5cc66d3c3","Type":"ContainerDied","Data":"b2938e534171b72ed3c00ee1a6e808167d0116cfd3d8dfd474d77c190b149597"}
Sep 06 01:22:00.252150 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:00.252035    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2938e534171b72ed3c00ee1a6e808167d0116cfd3d8dfd474d77c190b149597"
Sep 06 01:22:08.956830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:08.956793    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:22:08.957294 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:08.957055    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" podUID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" containerName="maas-api" containerID="cri-o://dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8" gracePeriod=30
Sep 06 01:22:09.158863 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.158811    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"]
Sep 06 01:22:09.161007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.160983    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-52c53f94-5b7jf"]
Sep 06 01:22:09.216289 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.216229    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:22:09.285776 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.285743    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:22:09.286022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.285998    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" containerID="cri-o://0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b" gracePeriod=30
Sep 06 01:22:09.301190 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.301159    2557 generic.go:356] "Generic (PLEG): container finished" podID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" containerID="dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8" exitCode=0
Sep 06 01:22:09.301357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.301260    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" event={"ID":"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31","Type":"ContainerDied","Data":"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"}
Sep 06 01:22:09.301357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.301310    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k" event={"ID":"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31","Type":"ContainerDied","Data":"2af3038076054b73e24272fc7102f67723bc69967a87c029558f0a0b5362ed72"}
Sep 06 01:22:09.301357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.301264    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"
Sep 06 01:22:09.301539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.301342    2557 scope.go:117] "RemoveContainer" containerID="dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"
Sep 06 01:22:09.311710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.311687    2557 scope.go:117] "RemoveContainer" containerID="dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"
Sep 06 01:22:09.312083 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:09.312057    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8\": container with ID starting with dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8 not found: ID does not exist" containerID="dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"
Sep 06 01:22:09.312221 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.312093    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8"} err="failed to get container status \"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8\": rpc error: code = NotFound desc = could not find container \"dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8\": container with ID starting with dd17d7f3653491fbe87a1e2f93d12dc3687c63e3828cf53ef3d4554d266b4af8 not found: ID does not exist"
Sep 06 01:22:09.342541 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.342502    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") pod \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") "
Sep 06 01:22:09.342730 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.342605    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t986g\" (UniqueName: \"kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g\") pod \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") "
Sep 06 01:22:09.342730 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.342643    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca\") pod \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\" (UID: \"6ab71cfa-9fe6-4a45-bc3e-47f021eedb31\") "
Sep 06 01:22:09.343035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.343007    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" (UID: "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:09.344812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.344782    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" (UID: "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:22:09.344927 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.344824    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g" (OuterVolumeSpecName: "kube-api-access-t986g") pod "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" (UID: "6ab71cfa-9fe6-4a45-bc3e-47f021eedb31"). InnerVolumeSpecName "kube-api-access-t986g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:09.443407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.443371    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.443407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.443402    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.443407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.443411    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t986g\" (UniqueName: \"kubernetes.io/projected/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31-kube-api-access-t986g\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:09.623188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.623159    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:22:09.627037 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.627013    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-52c53f94-749b6f87fb-6pp6k"]
Sep 06 01:22:09.969224 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969188    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:09.969808 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969793    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" containerName="maas-api"
Sep 06 01:22:09.969856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969811    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" containerName="maas-api"
Sep 06 01:22:09.969856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969836    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87fc557e-957a-4b4b-b558-d6f5cc66d3c3" containerName="revoke-keys"
Sep 06 01:22:09.969856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969846    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="87fc557e-957a-4b4b-b558-d6f5cc66d3c3" containerName="revoke-keys"
Sep 06 01:22:09.969968 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969954    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="87fc557e-957a-4b4b-b558-d6f5cc66d3c3" containerName="revoke-keys"
Sep 06 01:22:09.970003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.969971    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" containerName="maas-api"
Sep 06 01:22:09.974428 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.974401    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:09.977191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.977167    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-62f64172-openshift-default-dockercfg-w8rtc\""
Sep 06 01:22:09.983819 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:09.983800    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:10.049002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.048970    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049037    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049186    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049278    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh7w9\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049320    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.049493 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.049366    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.150863 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.150822    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.150878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.150926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.150959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151003    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151039    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151377 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh7w9\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151377 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151122    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151377 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.151975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.151898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.152085 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.152011    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.152362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.152333    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.153843 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.153820    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.154616 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.154576    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.160419 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.160367    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.160960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.160930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh7w9\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9\") pod \"e2e-ait-62f64172-openshift-default-84657f779b-rdnx4\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") " pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.167833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.167803    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab71cfa-9fe6-4a45-bc3e-47f021eedb31" path="/var/lib/kubelet/pods/6ab71cfa-9fe6-4a45-bc3e-47f021eedb31/volumes"
Sep 06 01:22:10.168332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.168312    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87fc557e-957a-4b4b-b558-d6f5cc66d3c3" path="/var/lib/kubelet/pods/87fc557e-957a-4b4b-b558-d6f5cc66d3c3/volumes"
Sep 06 01:22:10.285753 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.285666    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:10.564640 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.564494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:10.567280 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:22:10.567251    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bac58c5_de08_413d_b306_ec66aadb9b5f.slice/crio-d7ca18b43dee5df40a2fdeea24a607cdab9b820a75ff19f4ad1ed214d5f764b5 WatchSource:0}: Error finding container d7ca18b43dee5df40a2fdeea24a607cdab9b820a75ff19f4ad1ed214d5f764b5: Status 404 returned error can't find the container with id d7ca18b43dee5df40a2fdeea24a607cdab9b820a75ff19f4ad1ed214d5f764b5
Sep 06 01:22:10.569666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.569634    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:10.569758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.569697    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:10.569758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.569730    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:10.980688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.980649    2557 patch_prober.go:28] interesting pod/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:22:10.981060 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:10.980711    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:22:11.316149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:11.316057    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerStarted","Data":"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"}
Sep 06 01:22:11.316149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:11.316125    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerStarted","Data":"d7ca18b43dee5df40a2fdeea24a607cdab9b820a75ff19f4ad1ed214d5f764b5"}
Sep 06 01:22:11.337331 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:11.337286    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podStartSLOduration=2.337270939 podStartE2EDuration="2.337270939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:11.335643961 +0000 UTC m=+799.661063938" watchObservedRunningTime="2026-09-06 01:22:11.337270939 +0000 UTC m=+799.662690916"
Sep 06 01:22:12.286636 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:12.286601    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:12.292407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:12.292377    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:12.321621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:12.321596    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:12.322409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:12.322390    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:13.846138 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.846086    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:13.852901 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.852879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:13.856067 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.856046    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-62f64172-serving-cert\""
Sep 06 01:22:13.866210 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.866189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:13.988194 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.988157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67h2t\" (UniqueName: \"kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:13.988353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.988220    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:13.988353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:13.988335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.089641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.089604    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67h2t\" (UniqueName: \"kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.089806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.089657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.089806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.089703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.089897 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:14.089812    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-serving-cert: secret "maas-api-e2e-ait-62f64172-serving-cert" not found
Sep 06 01:22:14.089897 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:14.089876    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls podName:fb9eaa3b-aabc-44c5-add4-354ddef60238 nodeName:}" failed. No retries permitted until 2026-09-06 01:22:14.589859738 +0000 UTC m=+802.915279692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls") pod "maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" (UID: "fb9eaa3b-aabc-44c5-add4-354ddef60238") : secret "maas-api-e2e-ait-62f64172-serving-cert" not found
Sep 06 01:22:14.090314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.090296    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.099081 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.099029    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67h2t\" (UniqueName: \"kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.604882 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.597787    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.604882 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.602649    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") pod \"maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.717442 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.717414    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:22:14.764449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.764412    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:14.800170 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800098    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800257    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800290    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800335    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800430    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800475    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v66q\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800504    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800546    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token\") pod \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\" (UID: \"255aabaf-0876-4c2d-bbd5-b09e9f14eee4\") "
Sep 06 01:22:14.800601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800557    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data" (OuterVolumeSpecName: "istio-data") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:14.800858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800601    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:14.800858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800744    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:14.800858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800705    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:14.801018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800954    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.801018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800977    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.801018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.800991    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.801018 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.801005    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.801301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.801218    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:14.803166 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.803136    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token" (OuterVolumeSpecName: "istio-token") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:14.803497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.803471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:22:14.803583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.803471    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:14.803583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.803551    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q" (OuterVolumeSpecName: "kube-api-access-7v66q") pod "255aabaf-0876-4c2d-bbd5-b09e9f14eee4" (UID: "255aabaf-0876-4c2d-bbd5-b09e9f14eee4"). InnerVolumeSpecName "kube-api-access-7v66q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:14.902007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.901973    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.902007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.902003    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v66q\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-kube-api-access-7v66q\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.902007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.902014    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.902458 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.902023    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:14.902458 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:14.902032    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255aabaf-0876-4c2d-bbd5-b09e9f14eee4-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:15.046896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.046808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:15.050950 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:22:15.050902    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9eaa3b_aabc_44c5_add4_354ddef60238.slice/crio-f4d47908459d7882179e96a68de6a0918af9263626f50544d5caad35c55a9bf3 WatchSource:0}: Error finding container f4d47908459d7882179e96a68de6a0918af9263626f50544d5caad35c55a9bf3: Status 404 returned error can't find the container with id f4d47908459d7882179e96a68de6a0918af9263626f50544d5caad35c55a9bf3
Sep 06 01:22:15.341140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.341019    2557 generic.go:356] "Generic (PLEG): container finished" podID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerID="0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b" exitCode=0
Sep 06 01:22:15.341140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.341087    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"
Sep 06 01:22:15.341386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.341083    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerDied","Data":"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"}
Sep 06 01:22:15.341386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.341245    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b" event={"ID":"255aabaf-0876-4c2d-bbd5-b09e9f14eee4","Type":"ContainerDied","Data":"831f8933b70bac5bd5ed2266754168ec67fbfc12d100218dd02f223b16dbbbf4"}
Sep 06 01:22:15.341386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.341279    2557 scope.go:117] "RemoveContainer" containerID="0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"
Sep 06 01:22:15.343352 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.343221    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" event={"ID":"fb9eaa3b-aabc-44c5-add4-354ddef60238","Type":"ContainerStarted","Data":"f4d47908459d7882179e96a68de6a0918af9263626f50544d5caad35c55a9bf3"}
Sep 06 01:22:15.353810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.353785    2557 scope.go:117] "RemoveContainer" containerID="a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"
Sep 06 01:22:15.365947 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.365925    2557 scope.go:117] "RemoveContainer" containerID="0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"
Sep 06 01:22:15.366299 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:15.366277    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b\": container with ID starting with 0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b not found: ID does not exist" containerID="0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"
Sep 06 01:22:15.366386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.366309    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b"} err="failed to get container status \"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b\": rpc error: code = NotFound desc = could not find container \"0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b\": container with ID starting with 0b7e485e8d9c6fefe4aad0f4af0cd4275d29f97aaf671b9e19e0dd1101f7fc0b not found: ID does not exist"
Sep 06 01:22:15.366386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.366337    2557 scope.go:117] "RemoveContainer" containerID="a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"
Sep 06 01:22:15.366699 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:15.366676    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b\": container with ID starting with a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b not found: ID does not exist" containerID="a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"
Sep 06 01:22:15.366785 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.366708    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b"} err="failed to get container status \"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b\": rpc error: code = NotFound desc = could not find container \"a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b\": container with ID starting with a632b16bfbdaed187a8d46258438556e2735d14abbbf6d0af1ec89d59676b95b not found: ID does not exist"
Sep 06 01:22:15.367177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.367149    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:22:15.372390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:15.372370    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-52c53f94-gw-openshift-default-76d6db5bb8-gvk6b"]
Sep 06 01:22:16.163719 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:16.163687    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" path="/var/lib/kubelet/pods/255aabaf-0876-4c2d-bbd5-b09e9f14eee4/volumes"
Sep 06 01:22:16.351114 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:16.351076    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" event={"ID":"fb9eaa3b-aabc-44c5-add4-354ddef60238","Type":"ContainerStarted","Data":"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"}
Sep 06 01:22:16.351290 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:16.351271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:16.369064 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:16.369012    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" podStartSLOduration=2.95711435 podStartE2EDuration="3.368994201s" totalImagesPullingTime="411.879851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:16.367192854 +0000 UTC m=+804.692612833" watchObservedRunningTime="2026-09-06 01:22:16.368994201 +0000 UTC m=+804.694414209"
Sep 06 01:22:22.361971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:22.361939    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:35.455485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.455450    2557 generic.go:356] "Generic (PLEG): container finished" podID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerID="70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c" exitCode=0
Sep 06 01:22:35.455883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.455522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerDied","Data":"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"}
Sep 06 01:22:35.455932 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.455919    2557 scope.go:117] "RemoveContainer" containerID="70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"
Sep 06 01:22:35.457041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.457012    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:35.457124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.457089    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:35.457166 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:35.457147    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:36.466706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:36.466663    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerStarted","Data":"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"}
Sep 06 01:22:37.286714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:37.286670    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:37.286907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:37.286880    2557 patch_prober.go:28] interesting pod/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 06 01:22:37.286966 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:37.286947    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 06 01:22:38.286744 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.286707    2557 patch_prober.go:28] interesting pod/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 06 01:22:38.287201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.286768    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 06 01:22:38.338822 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.338787    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"]
Sep 06 01:22:38.339260 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.339246    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:38.339314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.339262    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:38.339314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.339275    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:38.339314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.339281    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:38.339409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.339347    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:38.348603 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.348567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:38.351210 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.351183    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:22:38.352806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.352778    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"]
Sep 06 01:22:38.525625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.525589    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-62f64172-62h24\" (UID: \"504396b5-4f53-45cc-83aa-6102cbc7914d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:38.626515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.626413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-62f64172-62h24\" (UID: \"504396b5-4f53-45cc-83aa-6102cbc7914d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:38.627034 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.627013    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-62f64172-62h24\" (UID: \"504396b5-4f53-45cc-83aa-6102cbc7914d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:38.671879 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.671834    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:38.963303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:38.963269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"]
Sep 06 01:22:38.972169 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:22:38.972140    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504396b5_4f53_45cc_83aa_6102cbc7914d.slice/crio-5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb WatchSource:0}: Error finding container 5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb: Status 404 returned error can't find the container with id 5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb
Sep 06 01:22:39.286273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:39.286240    2557 patch_prober.go:28] interesting pod/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 06 01:22:39.286441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:39.286308    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 06 01:22:39.490612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:39.490575    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24" event={"ID":"504396b5-4f53-45cc-83aa-6102cbc7914d","Type":"ContainerStarted","Data":"2ae613ef20e83648314d8fd145310b61e6d6c19a2d888f464502616585a694dd"}
Sep 06 01:22:39.491073 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:39.490634    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24" event={"ID":"504396b5-4f53-45cc-83aa-6102cbc7914d","Type":"ContainerStarted","Data":"5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb"}
Sep 06 01:22:39.509029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:39.508979    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24" podStartSLOduration=1.5089653360000002 podStartE2EDuration="1.508965336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:39.506630562 +0000 UTC m=+827.832050539" watchObservedRunningTime="2026-09-06 01:22:39.508965336 +0000 UTC m=+827.834385360"
Sep 06 01:22:40.286249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:40.286161    2557 patch_prober.go:28] interesting pod/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 06 01:22:40.286249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:40.286214    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 06 01:22:40.497278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:40.497246    2557 generic.go:356] "Generic (PLEG): container finished" podID="504396b5-4f53-45cc-83aa-6102cbc7914d" containerID="2ae613ef20e83648314d8fd145310b61e6d6c19a2d888f464502616585a694dd" exitCode=0
Sep 06 01:22:40.497661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:40.497286    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24" event={"ID":"504396b5-4f53-45cc-83aa-6102cbc7914d","Type":"ContainerDied","Data":"2ae613ef20e83648314d8fd145310b61e6d6c19a2d888f464502616585a694dd"}
Sep 06 01:22:41.286652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.286611    2557 patch_prober.go:28] interesting pod/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 06 01:22:41.286840 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.286675    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 06 01:22:41.649612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.649564    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:41.666120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.666070    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca\") pod \"504396b5-4f53-45cc-83aa-6102cbc7914d\" (UID: \"504396b5-4f53-45cc-83aa-6102cbc7914d\") "
Sep 06 01:22:41.666847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.666814    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "504396b5-4f53-45cc-83aa-6102cbc7914d" (UID: "504396b5-4f53-45cc-83aa-6102cbc7914d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:41.767617 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:41.767578    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/504396b5-4f53-45cc-83aa-6102cbc7914d-maas-api-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:42.289849 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.289814    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:42.290137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.290113    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:42.290725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.290707    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:42.509916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.509887    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"
Sep 06 01:22:42.510080 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.509926    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24" event={"ID":"504396b5-4f53-45cc-83aa-6102cbc7914d","Type":"ContainerDied","Data":"5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb"}
Sep 06 01:22:42.510080 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:42.509971    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a58b088c0f3f35eabba61d89bf1bea5afe884806c4508b97a13a1988d44fcfb"
Sep 06 01:22:44.237288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.237252    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:44.237773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.237530    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" podUID="fb9eaa3b-aabc-44c5-add4-354ddef60238" containerName="maas-api" containerID="cri-o://e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a" gracePeriod=30
Sep 06 01:22:44.431451 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.431417    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"]
Sep 06 01:22:44.433383 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.433355    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-62f64172-62h24"]
Sep 06 01:22:44.502144 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.502071    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:44.525508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.525471    2557 generic.go:356] "Generic (PLEG): container finished" podID="fb9eaa3b-aabc-44c5-add4-354ddef60238" containerID="e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a" exitCode=0
Sep 06 01:22:44.525968 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.525914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" event={"ID":"fb9eaa3b-aabc-44c5-add4-354ddef60238","Type":"ContainerDied","Data":"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"}
Sep 06 01:22:44.526249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.526229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml" event={"ID":"fb9eaa3b-aabc-44c5-add4-354ddef60238","Type":"ContainerDied","Data":"f4d47908459d7882179e96a68de6a0918af9263626f50544d5caad35c55a9bf3"}
Sep 06 01:22:44.526466 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.526421    2557 scope.go:117] "RemoveContainer" containerID="e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"
Sep 06 01:22:44.526945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.526855    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"
Sep 06 01:22:44.539263 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.539241    2557 scope.go:117] "RemoveContainer" containerID="e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"
Sep 06 01:22:44.539637 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:44.539615    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a\": container with ID starting with e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a not found: ID does not exist" containerID="e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"
Sep 06 01:22:44.539726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.539646    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a"} err="failed to get container status \"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a\": rpc error: code = NotFound desc = could not find container \"e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a\": container with ID starting with e00e9fd7d03122f0c2fbdcb2b15288e4ac0bbde7213267f16adbda7bec58945a not found: ID does not exist"
Sep 06 01:22:44.593262 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.593234    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") pod \"fb9eaa3b-aabc-44c5-add4-354ddef60238\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") "
Sep 06 01:22:44.593427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.593293    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca\") pod \"fb9eaa3b-aabc-44c5-add4-354ddef60238\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") "
Sep 06 01:22:44.593427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.593343    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67h2t\" (UniqueName: \"kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t\") pod \"fb9eaa3b-aabc-44c5-add4-354ddef60238\" (UID: \"fb9eaa3b-aabc-44c5-add4-354ddef60238\") "
Sep 06 01:22:44.593679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.593650    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb9eaa3b-aabc-44c5-add4-354ddef60238" (UID: "fb9eaa3b-aabc-44c5-add4-354ddef60238"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:44.595371 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.595349    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t" (OuterVolumeSpecName: "kube-api-access-67h2t") pod "fb9eaa3b-aabc-44c5-add4-354ddef60238" (UID: "fb9eaa3b-aabc-44c5-add4-354ddef60238"). InnerVolumeSpecName "kube-api-access-67h2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:44.595473 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.595448    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb9eaa3b-aabc-44c5-add4-354ddef60238" (UID: "fb9eaa3b-aabc-44c5-add4-354ddef60238"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:22:44.694390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.694360    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb9eaa3b-aabc-44c5-add4-354ddef60238-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:44.694390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.694386    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67h2t\" (UniqueName: \"kubernetes.io/projected/fb9eaa3b-aabc-44c5-add4-354ddef60238-kube-api-access-67h2t\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:44.694390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.694396    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb9eaa3b-aabc-44c5-add4-354ddef60238-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:44.848169 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.848141    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:44.852813 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:44.852787    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-62f64172-7c6fdc96cd-6mlml"]
Sep 06 01:22:45.478615 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:45.478578    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:45.479135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:45.478809    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy" containerID="cri-o://ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033" gracePeriod=30
Sep 06 01:22:46.165651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.165621    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504396b5-4f53-45cc-83aa-6102cbc7914d" path="/var/lib/kubelet/pods/504396b5-4f53-45cc-83aa-6102cbc7914d/volumes"
Sep 06 01:22:46.166031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.166018    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb9eaa3b-aabc-44c5-add4-354ddef60238" path="/var/lib/kubelet/pods/fb9eaa3b-aabc-44c5-add4-354ddef60238/volumes"
Sep 06 01:22:46.180928 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.180900    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:22:46.181341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181325    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9eaa3b-aabc-44c5-add4-354ddef60238" containerName="maas-api"
Sep 06 01:22:46.181341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181341    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9eaa3b-aabc-44c5-add4-354ddef60238" containerName="maas-api"
Sep 06 01:22:46.181503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181359    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504396b5-4f53-45cc-83aa-6102cbc7914d" containerName="revoke-keys"
Sep 06 01:22:46.181503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181365    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="504396b5-4f53-45cc-83aa-6102cbc7914d" containerName="revoke-keys"
Sep 06 01:22:46.181503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181420    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb9eaa3b-aabc-44c5-add4-354ddef60238" containerName="maas-api"
Sep 06 01:22:46.181503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181428    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="504396b5-4f53-45cc-83aa-6102cbc7914d" containerName="revoke-keys"
Sep 06 01:22:46.181503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.181438    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="255aabaf-0876-4c2d-bbd5-b09e9f14eee4" containerName="istio-proxy"
Sep 06 01:22:46.185912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.185893    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.188271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.188251    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bb49d333-openshift-default-dockercfg-g6l85\""
Sep 06 01:22:46.194946 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.194923    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:22:46.208788 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrt8g\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.208913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.208913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.208913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.209019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.209019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.208969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.209019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.209006    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.209156 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.209047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.209156 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.209074    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310276 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310242    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310326    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310471    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrt8g\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310586    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.310864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310846    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.311087 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310867    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.311087 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.310986    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.311312 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.311295    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.312666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.312646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.312816 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.312800    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.319002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.318975    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrt8g\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.319253 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.319236    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token\") pod \"e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") " pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.497296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.497263    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:46.774122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.773901    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:22:46.776864 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:22:46.776837    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47feabd3_beee_4468_b122_657f847b20d5.slice/crio-a0c1fa1f40bedf74d555eede7590025c949d2d73ccb0c9ba67d5624285cf0f3c WatchSource:0}: Error finding container a0c1fa1f40bedf74d555eede7590025c949d2d73ccb0c9ba67d5624285cf0f3c: Status 404 returned error can't find the container with id a0c1fa1f40bedf74d555eede7590025c949d2d73ccb0c9ba67d5624285cf0f3c
Sep 06 01:22:46.779383 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.779343    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:46.779458 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.779433    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:46.779494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:46.779479    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:22:47.548648 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:47.548609    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerStarted","Data":"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"}
Sep 06 01:22:47.549040 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:47.548675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerStarted","Data":"a0c1fa1f40bedf74d555eede7590025c949d2d73ccb0c9ba67d5624285cf0f3c"}
Sep 06 01:22:47.570549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:47.570491    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podStartSLOduration=1.570476859 podStartE2EDuration="1.570476859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:47.567736325 +0000 UTC m=+835.893156302" watchObservedRunningTime="2026-09-06 01:22:47.570476859 +0000 UTC m=+835.895896835"
Sep 06 01:22:48.498115 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:48.498071    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:48.503710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:48.503686    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:48.554634 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:48.554606    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:48.555607 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:48.555586    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:22:50.009226 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.009196    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:22:50.012820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.012792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.015353 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.015329    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-bb49d333-serving-cert\""
Sep 06 01:22:50.028079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.028056    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:22:50.052289 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.052259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.052426 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.052314    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8nmm\" (UniqueName: \"kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.052426 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.052355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.153403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.153367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.153577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.153414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8nmm\" (UniqueName: \"kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.153577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.153449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.154044 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.154012    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.155854 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.155834    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.166241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.166219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8nmm\" (UniqueName: \"kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm\") pod \"maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.323756 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.323664    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:50.610987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.610960    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:22:50.613682 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:22:50.613656    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e7b913_c1d6_4459_8d0f_f10161d044f8.slice/crio-a7ae4eb44d21cf17a0a2f8349fb1dc2cb55fe5cad62741738044f0022948afea WatchSource:0}: Error finding container a7ae4eb44d21cf17a0a2f8349fb1dc2cb55fe5cad62741738044f0022948afea: Status 404 returned error can't find the container with id a7ae4eb44d21cf17a0a2f8349fb1dc2cb55fe5cad62741738044f0022948afea
Sep 06 01:22:50.722743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.722720    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:50.758998 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.758971    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759029    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759054    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759121    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759176    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759220    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759226    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759247    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh7w9\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759280    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759330    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs\") pod \"4bac58c5-de08-413d-b306-ec66aadb9b5f\" (UID: \"4bac58c5-de08-413d-b306-ec66aadb9b5f\") "
Sep 06 01:22:50.759820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759639    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:50.759820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759646    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:22:50.759820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759698    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.759995 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759828    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:50.759995 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.759957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:50.761571 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.761533    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:22:50.761698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.761676    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:22:50.761836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.761812    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:50.762193 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.762164    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9" (OuterVolumeSpecName: "kube-api-access-qh7w9") pod "4bac58c5-de08-413d-b306-ec66aadb9b5f" (UID: "4bac58c5-de08-413d-b306-ec66aadb9b5f"). InnerVolumeSpecName "kube-api-access-qh7w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860463    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860493    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860503    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bac58c5-de08-413d-b306-ec66aadb9b5f-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860511    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860519    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh7w9\" (UniqueName: \"kubernetes.io/projected/4bac58c5-de08-413d-b306-ec66aadb9b5f-kube-api-access-qh7w9\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860527    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860535    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:50.860540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:50.860543    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bac58c5-de08-413d-b306-ec66aadb9b5f-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:22:51.572910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.572871    2557 generic.go:356] "Generic (PLEG): container finished" podID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerID="ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033" exitCode=0
Sep 06 01:22:51.573345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.572917    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"
Sep 06 01:22:51.573345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.572951    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerDied","Data":"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"}
Sep 06 01:22:51.573345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.573004    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4" event={"ID":"4bac58c5-de08-413d-b306-ec66aadb9b5f","Type":"ContainerDied","Data":"d7ca18b43dee5df40a2fdeea24a607cdab9b820a75ff19f4ad1ed214d5f764b5"}
Sep 06 01:22:51.573345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.573029    2557 scope.go:117] "RemoveContainer" containerID="ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"
Sep 06 01:22:51.575002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.574963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" event={"ID":"89e7b913-c1d6-4459-8d0f-f10161d044f8","Type":"ContainerStarted","Data":"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"}
Sep 06 01:22:51.575153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.575013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" event={"ID":"89e7b913-c1d6-4459-8d0f-f10161d044f8","Type":"ContainerStarted","Data":"a7ae4eb44d21cf17a0a2f8349fb1dc2cb55fe5cad62741738044f0022948afea"}
Sep 06 01:22:51.575153 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.575038    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:22:51.582839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.582815    2557 scope.go:117] "RemoveContainer" containerID="70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"
Sep 06 01:22:51.591320 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.591301    2557 scope.go:117] "RemoveContainer" containerID="ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"
Sep 06 01:22:51.591602 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:51.591583    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033\": container with ID starting with ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033 not found: ID does not exist" containerID="ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"
Sep 06 01:22:51.591670 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.591615    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033"} err="failed to get container status \"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033\": rpc error: code = NotFound desc = could not find container \"ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033\": container with ID starting with ec41433a8a49617826c32025e9837a916aa03657069769877635943288822033 not found: ID does not exist"
Sep 06 01:22:51.591670 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.591638    2557 scope.go:117] "RemoveContainer" containerID="70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"
Sep 06 01:22:51.591910 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:22:51.591893    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c\": container with ID starting with 70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c not found: ID does not exist" containerID="70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"
Sep 06 01:22:51.591953 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.591916    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c"} err="failed to get container status \"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c\": rpc error: code = NotFound desc = could not find container \"70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c\": container with ID starting with 70ba867a53f84ca4f867cf8d1d2961d99d0bdfd5dfccb86845879b72241b248c not found: ID does not exist"
Sep 06 01:22:51.599010 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.598971    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" podStartSLOduration=2.181533929 podStartE2EDuration="2.59895799s" totalImagesPullingTime="417.424061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:22:51.595959818 +0000 UTC m=+839.921379796" watchObservedRunningTime="2026-09-06 01:22:51.59895799 +0000 UTC m=+839.924377967"
Sep 06 01:22:51.610580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.610556    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:51.612427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:51.612408    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-62f64172-openshift-default-84657f779b-rdnx4"]
Sep 06 01:22:52.166029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:52.165993    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" path="/var/lib/kubelet/pods/4bac58c5-de08-413d-b306-ec66aadb9b5f/volumes"
Sep 06 01:22:57.585860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:22:57.585832    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:23:10.693388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.693350    2557 generic.go:356] "Generic (PLEG): container finished" podID="47feabd3-beee-4468-b122-657f847b20d5" containerID="5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0" exitCode=0
Sep 06 01:23:10.693823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.693425    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerDied","Data":"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"}
Sep 06 01:23:10.693868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.693842    2557 scope.go:117] "RemoveContainer" containerID="5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"
Sep 06 01:23:10.694964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.694933    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:23:10.695020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.695005    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:23:10.695079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:10.695036    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:23:11.701850 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:11.701808    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerStarted","Data":"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"}
Sep 06 01:23:12.498399 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:12.498364    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:12.498571 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:12.498544    2557 patch_prober.go:28] interesting pod/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:23:12.498622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:12.498594    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 01:23:13.497881 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.497839    2557 patch_prober.go:28] interesting pod/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:23:13.498275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.497911    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 01:23:13.736733 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.736700    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"]
Sep 06 01:23:13.737151 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737137    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.737201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737153    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.737201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737169    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.737201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737175    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.737305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737246    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.737305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.737258    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bac58c5-de08-413d-b306-ec66aadb9b5f" containerName="istio-proxy"
Sep 06 01:23:13.740505 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.740479    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:13.743324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.743296    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:23:13.750905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.750881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"]
Sep 06 01:23:13.885899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.885865    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bb49d333-rhtss\" (UID: \"59f242ee-597f-4720-a6a5-6d9560257b09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:13.987262 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.987221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bb49d333-rhtss\" (UID: \"59f242ee-597f-4720-a6a5-6d9560257b09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:13.987873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:13.987852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bb49d333-rhtss\" (UID: \"59f242ee-597f-4720-a6a5-6d9560257b09\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:14.059617 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:14.059520    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:14.335877 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:14.335855    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"]
Sep 06 01:23:14.337308 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:23:14.337272    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f242ee_597f_4720_a6a5_6d9560257b09.slice/crio-9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b WatchSource:0}: Error finding container 9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b: Status 404 returned error can't find the container with id 9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b
Sep 06 01:23:14.497686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:14.497651    2557 patch_prober.go:28] interesting pod/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:23:14.497840 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:14.497710    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 01:23:14.719290 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:14.719252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss" event={"ID":"59f242ee-597f-4720-a6a5-6d9560257b09","Type":"ContainerStarted","Data":"9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b"}
Sep 06 01:23:15.498420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:15.498378    2557 patch_prober.go:28] interesting pod/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:23:15.498627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:15.498453    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 01:23:15.725929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:15.725895    2557 generic.go:356] "Generic (PLEG): container finished" podID="59f242ee-597f-4720-a6a5-6d9560257b09" containerID="815e2a4d095a75832a0ddeb4817ae17ee077e3f90a75519d0a1425d8545a4bce" exitCode=0
Sep 06 01:23:15.726364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:15.725997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss" event={"ID":"59f242ee-597f-4720-a6a5-6d9560257b09","Type":"ContainerDied","Data":"815e2a4d095a75832a0ddeb4817ae17ee077e3f90a75519d0a1425d8545a4bce"}
Sep 06 01:23:16.497916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:16.497880    2557 patch_prober.go:28] interesting pod/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 01:23:16.498139 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:16.497941    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 01:23:16.891058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:16.891035    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:17.020664 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.020632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca\") pod \"59f242ee-597f-4720-a6a5-6d9560257b09\" (UID: \"59f242ee-597f-4720-a6a5-6d9560257b09\") "
Sep 06 01:23:17.020984 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.020960    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59f242ee-597f-4720-a6a5-6d9560257b09" (UID: "59f242ee-597f-4720-a6a5-6d9560257b09"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:23:17.122196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.122090    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59f242ee-597f-4720-a6a5-6d9560257b09-maas-api-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:17.501981 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.501949    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:17.502317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.502300    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:17.502909 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.502888    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:17.737547 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.737520    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"
Sep 06 01:23:17.737714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.737563    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss" event={"ID":"59f242ee-597f-4720-a6a5-6d9560257b09","Type":"ContainerDied","Data":"9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b"}
Sep 06 01:23:17.737714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:17.737615    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b302559cdaf19fb8340e4ac04c07e547ed48a70e41a8ea1db208b9146f4c00b"
Sep 06 01:23:20.434362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.434327    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:23:20.434811 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.434546    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" podUID="89e7b913-c1d6-4459-8d0f-f10161d044f8" containerName="maas-api" containerID="cri-o://bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e" gracePeriod=30
Sep 06 01:23:20.635247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.635212    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"]
Sep 06 01:23:20.639462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.639435    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bb49d333-rhtss"]
Sep 06 01:23:20.680967 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.680940    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:23:20.753515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.753465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8nmm\" (UniqueName: \"kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm\") pod \"89e7b913-c1d6-4459-8d0f-f10161d044f8\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") "
Sep 06 01:23:20.753725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.753535    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca\") pod \"89e7b913-c1d6-4459-8d0f-f10161d044f8\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") "
Sep 06 01:23:20.753725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.753610    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls\") pod \"89e7b913-c1d6-4459-8d0f-f10161d044f8\" (UID: \"89e7b913-c1d6-4459-8d0f-f10161d044f8\") "
Sep 06 01:23:20.754307 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.754272    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89e7b913-c1d6-4459-8d0f-f10161d044f8" (UID: "89e7b913-c1d6-4459-8d0f-f10161d044f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.757729    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89e7b913-c1d6-4459-8d0f-f10161d044f8" (UID: "89e7b913-c1d6-4459-8d0f-f10161d044f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.758548    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm" (OuterVolumeSpecName: "kube-api-access-l8nmm") pod "89e7b913-c1d6-4459-8d0f-f10161d044f8" (UID: "89e7b913-c1d6-4459-8d0f-f10161d044f8"). InnerVolumeSpecName "kube-api-access-l8nmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.758694    2557 generic.go:356] "Generic (PLEG): container finished" podID="89e7b913-c1d6-4459-8d0f-f10161d044f8" containerID="bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e" exitCode=0
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.758843    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" event={"ID":"89e7b913-c1d6-4459-8d0f-f10161d044f8","Type":"ContainerDied","Data":"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"}
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.758897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r" event={"ID":"89e7b913-c1d6-4459-8d0f-f10161d044f8","Type":"ContainerDied","Data":"a7ae4eb44d21cf17a0a2f8349fb1dc2cb55fe5cad62741738044f0022948afea"}
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.758927    2557 scope.go:117] "RemoveContainer" containerID="bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"
Sep 06 01:23:20.768241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.759077    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"
Sep 06 01:23:20.775170 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.775135    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:23:20.775431 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.775407    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy" containerID="cri-o://f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7" gracePeriod=30
Sep 06 01:23:20.789591 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.789568    2557 scope.go:117] "RemoveContainer" containerID="bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"
Sep 06 01:23:20.790024 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:23:20.790002    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e\": container with ID starting with bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e not found: ID does not exist" containerID="bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"
Sep 06 01:23:20.790140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.790035    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e"} err="failed to get container status \"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e\": rpc error: code = NotFound desc = could not find container \"bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e\": container with ID starting with bab47160083f341d8b56be120f4a90b02a0ccef35e54a150d5b8144f9bd54d6e not found: ID does not exist"
Sep 06 01:23:20.809736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.809703    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:23:20.819928 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.819896    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-bb49d333-78c445c6b9-v4f9r"]
Sep 06 01:23:20.854755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.854711    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89e7b913-c1d6-4459-8d0f-f10161d044f8-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:20.854755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.854745    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8nmm\" (UniqueName: \"kubernetes.io/projected/89e7b913-c1d6-4459-8d0f-f10161d044f8-kube-api-access-l8nmm\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:20.854755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:20.854757    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89e7b913-c1d6-4459-8d0f-f10161d044f8-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:22.163593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:22.163561    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59f242ee-597f-4720-a6a5-6d9560257b09" path="/var/lib/kubelet/pods/59f242ee-597f-4720-a6a5-6d9560257b09/volumes"
Sep 06 01:23:22.163957 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:22.163926    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e7b913-c1d6-4459-8d0f-f10161d044f8" path="/var/lib/kubelet/pods/89e7b913-c1d6-4459-8d0f-f10161d044f8/volumes"
Sep 06 01:23:26.133883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.133858    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:26.196552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196520    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196583    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196602    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196628    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196651    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196675    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrt8g\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196713    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196759    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.196977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196823    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:23:26.196977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196906    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket\") pod \"47feabd3-beee-4468-b122-657f847b20d5\" (UID: \"47feabd3-beee-4468-b122-657f847b20d5\") "
Sep 06 01:23:26.197219 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.196952    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:23:26.197219 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197033    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:23:26.197219 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197052    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:23:26.197375 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197265    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:23:26.197489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197424    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.197489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197467    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.197489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197484    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.197650 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197497    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/47feabd3-beee-4468-b122-657f847b20d5-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.197650 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.197510    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.198964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.198939    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:23:26.199123 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.199087    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g" (OuterVolumeSpecName: "kube-api-access-mrt8g") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "kube-api-access-mrt8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:23:26.199332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.199312    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:23:26.199392 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.199329    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "47feabd3-beee-4468-b122-657f847b20d5" (UID: "47feabd3-beee-4468-b122-657f847b20d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:23:26.298330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.298299    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.298330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.298324    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/47feabd3-beee-4468-b122-657f847b20d5-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.298330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.298333    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/47feabd3-beee-4468-b122-657f847b20d5-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.298538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.298341    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrt8g\" (UniqueName: \"kubernetes.io/projected/47feabd3-beee-4468-b122-657f847b20d5-kube-api-access-mrt8g\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:23:26.800441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.800403    2557 generic.go:356] "Generic (PLEG): container finished" podID="47feabd3-beee-4468-b122-657f847b20d5" containerID="f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7" exitCode=0
Sep 06 01:23:26.800441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.800443    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"
Sep 06 01:23:26.800653 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.800488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerDied","Data":"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"}
Sep 06 01:23:26.800653 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.800546    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w" event={"ID":"47feabd3-beee-4468-b122-657f847b20d5","Type":"ContainerDied","Data":"a0c1fa1f40bedf74d555eede7590025c949d2d73ccb0c9ba67d5624285cf0f3c"}
Sep 06 01:23:26.800653 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.800570    2557 scope.go:117] "RemoveContainer" containerID="f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"
Sep 06 01:23:26.810019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.810002    2557 scope.go:117] "RemoveContainer" containerID="5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"
Sep 06 01:23:26.818358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.818343    2557 scope.go:117] "RemoveContainer" containerID="f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"
Sep 06 01:23:26.818618 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:23:26.818600    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7\": container with ID starting with f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7 not found: ID does not exist" containerID="f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"
Sep 06 01:23:26.818663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.818626    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7"} err="failed to get container status \"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7\": rpc error: code = NotFound desc = could not find container \"f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7\": container with ID starting with f206dd5657332af189379de774bcc00db5c669d6db8824975d86312b1bd235b7 not found: ID does not exist"
Sep 06 01:23:26.818663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.818646    2557 scope.go:117] "RemoveContainer" containerID="5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"
Sep 06 01:23:26.818916 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:23:26.818895    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0\": container with ID starting with 5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0 not found: ID does not exist" containerID="5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"
Sep 06 01:23:26.819000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.818924    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0"} err="failed to get container status \"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0\": rpc error: code = NotFound desc = could not find container \"5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0\": container with ID starting with 5783516a6b7001ba612328550c99b122953ae25533ea40e86d0797fd019aaea0 not found: ID does not exist"
Sep 06 01:23:26.821728 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.821696    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:23:26.826524 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:26.826505    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bb49d333-openshift-default-5d59b47948-fz46w"]
Sep 06 01:23:28.163472 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:28.163439    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47feabd3-beee-4468-b122-657f847b20d5" path="/var/lib/kubelet/pods/47feabd3-beee-4468-b122-657f847b20d5/volumes"
Sep 06 01:23:52.162727 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:52.162649    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:23:52.165693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:23:52.165669    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:24:10.708459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708416    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"]
Sep 06 01:24:10.708825 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708802    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59f242ee-597f-4720-a6a5-6d9560257b09" containerName="revoke-keys"
Sep 06 01:24:10.708825 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708814    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="59f242ee-597f-4720-a6a5-6d9560257b09" containerName="revoke-keys"
Sep 06 01:24:10.708903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708831    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e7b913-c1d6-4459-8d0f-f10161d044f8" containerName="maas-api"
Sep 06 01:24:10.708903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708837    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e7b913-c1d6-4459-8d0f-f10161d044f8" containerName="maas-api"
Sep 06 01:24:10.708903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708845    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:10.708903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708851    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:10.709031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708921    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="59f242ee-597f-4720-a6a5-6d9560257b09" containerName="revoke-keys"
Sep 06 01:24:10.709031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708931    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:10.709031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708937    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:10.709031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.708943    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e7b913-c1d6-4459-8d0f-f10161d044f8" containerName="maas-api"
Sep 06 01:24:10.713384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.713362    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:10.715921 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.715897    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:24:10.721912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.721886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"]
Sep 06 01:24:10.804460 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.804426    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-20c535-24bbd\" (UID: \"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:10.905451 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.905416    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-20c535-24bbd\" (UID: \"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:10.906043 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:10.906024    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-20c535-24bbd\" (UID: \"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:11.025526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:11.025444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:11.297745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:11.297714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"]
Sep 06 01:24:11.300026 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:24:11.299997    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa24c6dc_c3fa_4a6b_a9f0_c0bbf35f9b97.slice/crio-f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0 WatchSource:0}: Error finding container f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0: Status 404 returned error can't find the container with id f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0
Sep 06 01:24:12.054408 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:12.054365    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd" event={"ID":"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97","Type":"ContainerStarted","Data":"9d5347076747d12dade8d0b2a8bcfd5baf59fdfe598ca65ac2096927f625601d"}
Sep 06 01:24:12.054842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:12.054486    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd" event={"ID":"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97","Type":"ContainerStarted","Data":"f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0"}
Sep 06 01:24:12.071506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:12.071458    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd" podStartSLOduration=2.071444323 podStartE2EDuration="2.071444323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:12.069139151 +0000 UTC m=+920.394559148" watchObservedRunningTime="2026-09-06 01:24:12.071444323 +0000 UTC m=+920.396864339"
Sep 06 01:24:13.061223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:13.061189    2557 generic.go:356] "Generic (PLEG): container finished" podID="aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" containerID="9d5347076747d12dade8d0b2a8bcfd5baf59fdfe598ca65ac2096927f625601d" exitCode=0
Sep 06 01:24:13.061223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:13.061230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd" event={"ID":"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97","Type":"ContainerDied","Data":"9d5347076747d12dade8d0b2a8bcfd5baf59fdfe598ca65ac2096927f625601d"}
Sep 06 01:24:14.202857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:14.202836    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:14.236363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:14.236336    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca\") pod \"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97\" (UID: \"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97\") "
Sep 06 01:24:14.236610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:14.236585    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" (UID: "aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:14.337552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:14.337488    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97-maas-api-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:15.074238 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:15.074207    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"
Sep 06 01:24:15.074453 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:15.074244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd" event={"ID":"aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97","Type":"ContainerDied","Data":"f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0"}
Sep 06 01:24:15.074453 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:15.074291    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f431942e985b902f062d12066b7426284b67aacc5d9ca366211f9d80fc3b46f0"
Sep 06 01:24:21.131071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.131035    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:24:21.131549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.131302    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" podUID="df74808e-ad4a-4501-ba32-a40290549c06" containerName="maas-api" containerID="cri-o://afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622" gracePeriod=30
Sep 06 01:24:21.181384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.181350    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:24:21.181837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.181801    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" podUID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" containerName="payload-pre-processing" containerID="cri-o://d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714" gracePeriod=30
Sep 06 01:24:21.321422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.321383    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"]
Sep 06 01:24:21.324586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.324510    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-20c535-24bbd"]
Sep 06 01:24:21.466958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.466937    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:24:21.470302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.470279    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:24:21.502306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502273    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") pod \"df74808e-ad4a-4501-ba32-a40290549c06\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") "
Sep 06 01:24:21.502465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502319    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume\") pod \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") "
Sep 06 01:24:21.502465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502392    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca\") pod \"df74808e-ad4a-4501-ba32-a40290549c06\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") "
Sep 06 01:24:21.502604 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502481    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqc4f\" (UniqueName: \"kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f\") pod \"df74808e-ad4a-4501-ba32-a40290549c06\" (UID: \"df74808e-ad4a-4501-ba32-a40290549c06\") "
Sep 06 01:24:21.502604 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502581    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc94c\" (UniqueName: \"kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c\") pod \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\" (UID: \"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c\") "
Sep 06 01:24:21.502714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502695    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" (UID: "c3f05a91-3b8c-44e8-a3fb-89125bf0c91c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:21.502774 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502698    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df74808e-ad4a-4501-ba32-a40290549c06" (UID: "df74808e-ad4a-4501-ba32-a40290549c06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:21.502940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502923    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-plugins-config-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.503026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.502947    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df74808e-ad4a-4501-ba32-a40290549c06-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.504394 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.504369    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df74808e-ad4a-4501-ba32-a40290549c06" (UID: "df74808e-ad4a-4501-ba32-a40290549c06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:24:21.504693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.504657    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f" (OuterVolumeSpecName: "kube-api-access-rqc4f") pod "df74808e-ad4a-4501-ba32-a40290549c06" (UID: "df74808e-ad4a-4501-ba32-a40290549c06"). InnerVolumeSpecName "kube-api-access-rqc4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:21.504969 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.504946    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c" (OuterVolumeSpecName: "kube-api-access-qc94c") pod "c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" (UID: "c3f05a91-3b8c-44e8-a3fb-89125bf0c91c"). InnerVolumeSpecName "kube-api-access-qc94c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:21.604029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.603994    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqc4f\" (UniqueName: \"kubernetes.io/projected/df74808e-ad4a-4501-ba32-a40290549c06-kube-api-access-rqc4f\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.604029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.604022    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc94c\" (UniqueName: \"kubernetes.io/projected/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c-kube-api-access-qc94c\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:21.604029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:21.604034    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df74808e-ad4a-4501-ba32-a40290549c06-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:22.112824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.112784    2557 generic.go:356] "Generic (PLEG): container finished" podID="df74808e-ad4a-4501-ba32-a40290549c06" containerID="afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622" exitCode=0
Sep 06 01:24:22.113022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.112854    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"
Sep 06 01:24:22.113022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.112868    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" event={"ID":"df74808e-ad4a-4501-ba32-a40290549c06","Type":"ContainerDied","Data":"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"}
Sep 06 01:24:22.113022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.112949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb" event={"ID":"df74808e-ad4a-4501-ba32-a40290549c06","Type":"ContainerDied","Data":"5bc62b2cf5e0ea654fe071eb32158704bd982f7d1a08101f85d8ea79f383e7d5"}
Sep 06 01:24:22.113022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.112975    2557 scope.go:117] "RemoveContainer" containerID="afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"
Sep 06 01:24:22.114420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.114383    2557 generic.go:356] "Generic (PLEG): container finished" podID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" containerID="d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714" exitCode=0
Sep 06 01:24:22.114420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.114413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" event={"ID":"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c","Type":"ContainerDied","Data":"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"}
Sep 06 01:24:22.114610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.114451    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"
Sep 06 01:24:22.114610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.114467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg" event={"ID":"c3f05a91-3b8c-44e8-a3fb-89125bf0c91c","Type":"ContainerDied","Data":"11c24b3e0a24c32770b5df5fde515a41e31e93966c39b78df4d911ce8e56b05b"}
Sep 06 01:24:22.127076 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.127057    2557 scope.go:117] "RemoveContainer" containerID="afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"
Sep 06 01:24:22.127374 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:24:22.127356    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622\": container with ID starting with afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622 not found: ID does not exist" containerID="afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"
Sep 06 01:24:22.127447 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.127381    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622"} err="failed to get container status \"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622\": rpc error: code = NotFound desc = could not find container \"afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622\": container with ID starting with afabd2e5e87f3b82ba1a95668ad11000059cbe9e2d9277c66064bf564b97e622 not found: ID does not exist"
Sep 06 01:24:22.127447 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.127397    2557 scope.go:117] "RemoveContainer" containerID="d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"
Sep 06 01:24:22.135617 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.135494    2557 scope.go:117] "RemoveContainer" containerID="d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"
Sep 06 01:24:22.135829 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:24:22.135742    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714\": container with ID starting with d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714 not found: ID does not exist" containerID="d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"
Sep 06 01:24:22.135829 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.135765    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714"} err="failed to get container status \"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714\": rpc error: code = NotFound desc = could not find container \"d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714\": container with ID starting with d466023259de1f6338cb82b56f2ddbe186aa29c1c7f2c7befc315b23f0d2c714 not found: ID does not exist"
Sep 06 01:24:22.139970 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.139949    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:24:22.143966 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.143948    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-20c535-6bdf5b77f4-h4kbg"]
Sep 06 01:24:22.155296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.155278    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:24:22.171175 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.171147    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" path="/var/lib/kubelet/pods/aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97/volumes"
Sep 06 01:24:22.171522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.171508    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" path="/var/lib/kubelet/pods/c3f05a91-3b8c-44e8-a3fb-89125bf0c91c/volumes"
Sep 06 01:24:22.171752 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:22.171739    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-20c535-7597ff6869-7gmdb"]
Sep 06 01:24:24.163114 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:24.163058    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df74808e-ad4a-4501-ba32-a40290549c06" path="/var/lib/kubelet/pods/df74808e-ad4a-4501-ba32-a40290549c06/volumes"
Sep 06 01:24:28.744261 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744226    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744609    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" containerName="revoke-keys"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744621    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" containerName="revoke-keys"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744633    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744639    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47feabd3-beee-4468-b122-657f847b20d5" containerName="istio-proxy"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744649    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df74808e-ad4a-4501-ba32-a40290549c06" containerName="maas-api"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744654    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="df74808e-ad4a-4501-ba32-a40290549c06" containerName="maas-api"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744666    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" containerName="payload-pre-processing"
Sep 06 01:24:28.744672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744671    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" containerName="payload-pre-processing"
Sep 06 01:24:28.745122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744723    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f05a91-3b8c-44e8-a3fb-89125bf0c91c" containerName="payload-pre-processing"
Sep 06 01:24:28.745122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744732    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa24c6dc-c3fa-4a6b-a9f0-c0bbf35f9b97" containerName="revoke-keys"
Sep 06 01:24:28.745122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.744738    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="df74808e-ad4a-4501-ba32-a40290549c06" containerName="maas-api"
Sep 06 01:24:28.754228 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.754205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.757175 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.757151    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-109eb6-openshift-default-dockercfg-nfw4d\""
Sep 06 01:24:28.761027 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.761005    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:24:28.867178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867259    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867410    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867455    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867492    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.867599 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.867532    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxjqh\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968524    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968589    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968852 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968622    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968852 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.968852 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxjqh\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.969017 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.969017 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.968998    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.969197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.969178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.969285 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.969264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.969434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.969411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.970728 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.970710    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.971147 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.971122    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.976702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.976672    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:28.976856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:28.976836    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxjqh\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh\") pod \"e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") " pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:29.067239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:29.067160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:29.344766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:29.344737    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:24:29.346709 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:24:29.346681    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0f36b2_c857_4bc1_b275_448fdfd3c3a8.slice/crio-64adf52d75ae85728f9f3ed5530dc635b6480c5b86f1acb8e1570af1b1a87ba9 WatchSource:0}: Error finding container 64adf52d75ae85728f9f3ed5530dc635b6480c5b86f1acb8e1570af1b1a87ba9: Status 404 returned error can't find the container with id 64adf52d75ae85728f9f3ed5530dc635b6480c5b86f1acb8e1570af1b1a87ba9
Sep 06 01:24:29.349254 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:29.349223    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:29.349330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:29.349286    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:29.349330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:29.349316    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:30.164693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:30.164655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerStarted","Data":"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"}
Sep 06 01:24:30.165058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:30.164704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerStarted","Data":"64adf52d75ae85728f9f3ed5530dc635b6480c5b86f1acb8e1570af1b1a87ba9"}
Sep 06 01:24:30.183590 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:30.183544    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podStartSLOduration=2.183529489 podStartE2EDuration="2.183529489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:30.181373264 +0000 UTC m=+938.506793242" watchObservedRunningTime="2026-09-06 01:24:30.183529489 +0000 UTC m=+938.508949465"
Sep 06 01:24:31.067889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:31.067851    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:31.073095 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:31.073069    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:31.168049 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:31.168015    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:31.168887 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:31.168867    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:33.272601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.272565    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:24:33.276443 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.276414    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.279271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.279246    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-109eb6-serving-cert\""
Sep 06 01:24:33.286852 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.286780    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:24:33.411597 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.411553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.411794 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.411626    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.411794 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.411679    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqzx6\" (UniqueName: \"kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.512595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.512559    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.512781 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.512617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.512781 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.512644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqzx6\" (UniqueName: \"kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.513250 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.513220    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.515582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.515554    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.520906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.520884    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqzx6\" (UniqueName: \"kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6\") pod \"maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.591770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.591691    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:33.866229 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:33.866202    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:24:33.868808 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:24:33.868783    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b16aac3_b7c4_4344_abef_98841fc3251c.slice/crio-077ff854ca387540b132d7e1c341091efaf81ce05aa41b5211aa82a8c9666608 WatchSource:0}: Error finding container 077ff854ca387540b132d7e1c341091efaf81ce05aa41b5211aa82a8c9666608: Status 404 returned error can't find the container with id 077ff854ca387540b132d7e1c341091efaf81ce05aa41b5211aa82a8c9666608
Sep 06 01:24:34.185231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:34.185096    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" event={"ID":"1b16aac3-b7c4-4344-abef-98841fc3251c","Type":"ContainerStarted","Data":"077ff854ca387540b132d7e1c341091efaf81ce05aa41b5211aa82a8c9666608"}
Sep 06 01:24:35.192558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:35.192520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" event={"ID":"1b16aac3-b7c4-4344-abef-98841fc3251c","Type":"ContainerStarted","Data":"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"}
Sep 06 01:24:35.192941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:35.192589    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:35.210125 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:35.210065    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" podStartSLOduration=1.809324083 podStartE2EDuration="2.210051502s" totalImagesPullingTime="400.727419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:35.209307939 +0000 UTC m=+943.534727921" watchObservedRunningTime="2026-09-06 01:24:35.210051502 +0000 UTC m=+943.535471479"
Sep 06 01:24:36.753065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.753032    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"]
Sep 06 01:24:36.756729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.756713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:36.759053 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.759034    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cpl4c\""
Sep 06 01:24:36.763759 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.763731    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"]
Sep 06 01:24:36.843604 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.843567    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49\" (UID: \"5bf70be7-f7ae-4a5a-85db-1f17d91755fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:36.944684 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.944648    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49\" (UID: \"5bf70be7-f7ae-4a5a-85db-1f17d91755fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:36.945650 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:36.945618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49\" (UID: \"5bf70be7-f7ae-4a5a-85db-1f17d91755fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:37.073270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:37.073192    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:37.344904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:37.344874    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"]
Sep 06 01:24:37.347794 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:24:37.347759    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf70be7_f7ae_4a5a_85db_1f17d91755fa.slice/crio-d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676 WatchSource:0}: Error finding container d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676: Status 404 returned error can't find the container with id d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676
Sep 06 01:24:38.210579 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:38.210541    2557 generic.go:356] "Generic (PLEG): container finished" podID="5bf70be7-f7ae-4a5a-85db-1f17d91755fa" containerID="768c01e4c7268bd938bf29ad31285267369f24f9826b88b770888134e7ab2c68" exitCode=0
Sep 06 01:24:38.210950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:38.210586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49" event={"ID":"5bf70be7-f7ae-4a5a-85db-1f17d91755fa","Type":"ContainerDied","Data":"768c01e4c7268bd938bf29ad31285267369f24f9826b88b770888134e7ab2c68"}
Sep 06 01:24:38.210950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:38.210645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49" event={"ID":"5bf70be7-f7ae-4a5a-85db-1f17d91755fa","Type":"ContainerStarted","Data":"d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676"}
Sep 06 01:24:39.355112 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:39.355075    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:39.466337 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:39.466294    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca\") pod \"5bf70be7-f7ae-4a5a-85db-1f17d91755fa\" (UID: \"5bf70be7-f7ae-4a5a-85db-1f17d91755fa\") "
Sep 06 01:24:39.466683 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:39.466628    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5bf70be7-f7ae-4a5a-85db-1f17d91755fa" (UID: "5bf70be7-f7ae-4a5a-85db-1f17d91755fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:39.567635 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:39.567584    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf70be7-f7ae-4a5a-85db-1f17d91755fa-maas-api-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:40.230656 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:40.230623    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"
Sep 06 01:24:40.231075 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:40.230665    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49" event={"ID":"5bf70be7-f7ae-4a5a-85db-1f17d91755fa","Type":"ContainerDied","Data":"d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676"}
Sep 06 01:24:40.231332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:40.231306    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1038703eb7f7b440a9305b2241b7d4800d1c769f8f9151f888285bc76cc1676"
Sep 06 01:24:41.203978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:41.203948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:24:47.287430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.287393    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:24:47.287875 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.287637    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" podUID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" containerName="maas-api" containerID="cri-o://8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d" gracePeriod=30
Sep 06 01:24:47.483148 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.483045    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"]
Sep 06 01:24:47.484857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.484833    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-b63fa0-7qd49"]
Sep 06 01:24:47.760163 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.760129    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:24:47.944992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.944948    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca\") pod \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") "
Sep 06 01:24:47.944992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.944986    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls\") pod \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") "
Sep 06 01:24:47.945296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.945051    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thvmn\" (UniqueName: \"kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn\") pod \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\" (UID: \"1a12c167-0bbb-43b9-97a0-753a4cb02f35\") "
Sep 06 01:24:47.945455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.945424    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1a12c167-0bbb-43b9-97a0-753a4cb02f35" (UID: "1a12c167-0bbb-43b9-97a0-753a4cb02f35"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:47.947814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.947786    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn" (OuterVolumeSpecName: "kube-api-access-thvmn") pod "1a12c167-0bbb-43b9-97a0-753a4cb02f35" (UID: "1a12c167-0bbb-43b9-97a0-753a4cb02f35"). InnerVolumeSpecName "kube-api-access-thvmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:47.947814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:47.947805    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1a12c167-0bbb-43b9-97a0-753a4cb02f35" (UID: "1a12c167-0bbb-43b9-97a0-753a4cb02f35"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:24:48.046743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.046703    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a12c167-0bbb-43b9-97a0-753a4cb02f35-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:48.046743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.046732    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a12c167-0bbb-43b9-97a0-753a4cb02f35-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:48.046743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.046741    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thvmn\" (UniqueName: \"kubernetes.io/projected/1a12c167-0bbb-43b9-97a0-753a4cb02f35-kube-api-access-thvmn\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:48.165923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.165890    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf70be7-f7ae-4a5a-85db-1f17d91755fa" path="/var/lib/kubelet/pods/5bf70be7-f7ae-4a5a-85db-1f17d91755fa/volumes"
Sep 06 01:24:48.289508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.289417    2557 generic.go:356] "Generic (PLEG): container finished" podID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" containerID="8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d" exitCode=0
Sep 06 01:24:48.289508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.289460    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"
Sep 06 01:24:48.289508 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.289493    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" event={"ID":"1a12c167-0bbb-43b9-97a0-753a4cb02f35","Type":"ContainerDied","Data":"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"}
Sep 06 01:24:48.290040 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.289543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2" event={"ID":"1a12c167-0bbb-43b9-97a0-753a4cb02f35","Type":"ContainerDied","Data":"d6226771ee476e846fdad6027de80866db85b65be963cf0d7c8443699af62557"}
Sep 06 01:24:48.290040 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.289566    2557 scope.go:117] "RemoveContainer" containerID="8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"
Sep 06 01:24:48.298411 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.298395    2557 scope.go:117] "RemoveContainer" containerID="8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"
Sep 06 01:24:48.298679 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:24:48.298660    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d\": container with ID starting with 8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d not found: ID does not exist" containerID="8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"
Sep 06 01:24:48.298754 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.298688    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d"} err="failed to get container status \"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d\": rpc error: code = NotFound desc = could not find container \"8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d\": container with ID starting with 8acfb1c1407ae3ce3c57fd51c1d08171662c42cbd17e01978302cf94a192775d not found: ID does not exist"
Sep 06 01:24:48.306668 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.306646    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:24:48.311837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:48.311817    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b63fa0-74d4f75b9-2h2j2"]
Sep 06 01:24:50.169345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.169311    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" path="/var/lib/kubelet/pods/1a12c167-0bbb-43b9-97a0-753a4cb02f35/volumes"
Sep 06 01:24:50.304002 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.303969    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerID="27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb" exitCode=0
Sep 06 01:24:50.304177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.304040    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerDied","Data":"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"}
Sep 06 01:24:50.304444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.304430    2557 scope.go:117] "RemoveContainer" containerID="27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"
Sep 06 01:24:50.305621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.305589    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:50.305689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.305675    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:50.305726 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:50.305712    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:51.311746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:51.311704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerStarted","Data":"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"}
Sep 06 01:24:52.067316 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:52.067279    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:52.067551 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:52.067526    2557 patch_prober.go:28] interesting pod/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 06 01:24:52.067625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:52.067586    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 06 01:24:53.067568 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:53.067523    2557 patch_prober.go:28] interesting pod/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 06 01:24:53.067959 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:53.067583    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 06 01:24:53.906081 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:53.906041    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:24:53.906330 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:53.906299    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" containerID="cri-o://50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56" gracePeriod=30
Sep 06 01:24:54.068469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:54.068425    2557 patch_prober.go:28] interesting pod/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 06 01:24:54.068948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:54.068487    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 06 01:24:55.068286 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:55.067817    2557 patch_prober.go:28] interesting pod/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 06 01:24:55.068286 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:55.067881    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 06 01:24:56.068187 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.068137    2557 patch_prober.go:28] interesting pod/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 06 01:24:56.068398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.068214    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 06 01:24:56.779481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.779444    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:24:56.780074 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780045    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" containerName="maas-api"
Sep 06 01:24:56.780074 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780075    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" containerName="maas-api"
Sep 06 01:24:56.780298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780133    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf70be7-f7ae-4a5a-85db-1f17d91755fa" containerName="revoke-keys"
Sep 06 01:24:56.780298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780149    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf70be7-f7ae-4a5a-85db-1f17d91755fa" containerName="revoke-keys"
Sep 06 01:24:56.780298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780264    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a12c167-0bbb-43b9-97a0-753a4cb02f35" containerName="maas-api"
Sep 06 01:24:56.780298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.780278    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf70be7-f7ae-4a5a-85db-1f17d91755fa" containerName="revoke-keys"
Sep 06 01:24:56.784940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.784918    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.787444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.787419    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f2686adc-openshift-default-dockercfg-996ks\""
Sep 06 01:24:56.798473 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.798438    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:24:56.832051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832170    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832194    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832215    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832246    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gkc\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.832469 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.832376    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933615    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933703    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933724    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933742    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933790    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.933844 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.933858    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gkc\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.934055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.934159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.934231    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.934294    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.934565 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.934544    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.936117 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.936090    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.936231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.936185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.942586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.942556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gkc\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:56.942749 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:56.942729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token\") pod \"e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") " pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:57.072417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.072330    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:57.072678 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.072658    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:57.073326 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.073309    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:24:57.096056 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.096023    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:57.387531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.387504    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:24:57.389317 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:24:57.389288    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ede90f5_510a_41b0_98c5_f88c57e5bd38.slice/crio-e162d6cf7e6a6d21a5d708a86da97e11018e9abd842cf350d6339787ed3c53a0 WatchSource:0}: Error finding container e162d6cf7e6a6d21a5d708a86da97e11018e9abd842cf350d6339787ed3c53a0: Status 404 returned error can't find the container with id e162d6cf7e6a6d21a5d708a86da97e11018e9abd842cf350d6339787ed3c53a0
Sep 06 01:24:57.391739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.391709    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:57.391809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.391779    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:57.391847 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:57.391809    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:24:58.267488 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:58.267449    2557 patch_prober.go:28] interesting pod/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:24:58.267861 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:58.267516    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:24:58.350309 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:58.350270    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerStarted","Data":"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"}
Sep 06 01:24:58.350504 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:58.350335    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerStarted","Data":"e162d6cf7e6a6d21a5d708a86da97e11018e9abd842cf350d6339787ed3c53a0"}
Sep 06 01:24:58.370661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:58.370602    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podStartSLOduration=2.37058644 podStartE2EDuration="2.37058644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:24:58.368786486 +0000 UTC m=+966.694206491" watchObservedRunningTime="2026-09-06 01:24:58.37058644 +0000 UTC m=+966.696006416"
Sep 06 01:24:59.096446 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.096416    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:59.101858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.101833    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:59.165812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.165784    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:24:59.253774 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253745    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253811    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253838    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253860    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253876    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253899    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.253962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.253945    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.254300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254007    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff8lm\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.254300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254026    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data\") pod \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\" (UID: \"32e640c0-7b8b-4d8e-a09b-9169bb60ae51\") "
Sep 06 01:24:59.254415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254305    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:59.254477 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254416    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:59.254477 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254434    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data" (OuterVolumeSpecName: "istio-data") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:59.254585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254501    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:24:59.254585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.254564    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:59.256030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.255994    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:24:59.256310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.256291    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm" (OuterVolumeSpecName: "kube-api-access-ff8lm") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "kube-api-access-ff8lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:59.256387 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.256361    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token" (OuterVolumeSpecName: "istio-token") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:24:59.256555 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.256485    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32e640c0-7b8b-4d8e-a09b-9169bb60ae51" (UID: "32e640c0-7b8b-4d8e-a09b-9169bb60ae51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:24:59.355215 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355185    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355215 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355209    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355215 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355217    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355226    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355236    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355245    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355253    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355261    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff8lm\" (UniqueName: \"kubernetes.io/projected/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-kube-api-access-ff8lm\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.355639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.355269    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32e640c0-7b8b-4d8e-a09b-9169bb60ae51-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:24:59.357821 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.357792    2557 generic.go:356] "Generic (PLEG): container finished" podID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerID="50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56" exitCode=0
Sep 06 01:24:59.357944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.357837    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"
Sep 06 01:24:59.357944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.357866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerDied","Data":"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"}
Sep 06 01:24:59.357944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.357916    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g" event={"ID":"32e640c0-7b8b-4d8e-a09b-9169bb60ae51","Type":"ContainerDied","Data":"5d855fee67c9bbde78a3af66673d5e04d9d38dfb0072d92ef5fb6fb31938f199"}
Sep 06 01:24:59.357944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.357939    2557 scope.go:117] "RemoveContainer" containerID="50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"
Sep 06 01:24:59.358224 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.358207    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:59.359244 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.359226    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:24:59.367464 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.367444    2557 scope.go:117] "RemoveContainer" containerID="7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"
Sep 06 01:24:59.375531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.375516    2557 scope.go:117] "RemoveContainer" containerID="50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"
Sep 06 01:24:59.375800 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:24:59.375782    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56\": container with ID starting with 50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56 not found: ID does not exist" containerID="50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"
Sep 06 01:24:59.375843 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.375809    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56"} err="failed to get container status \"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56\": rpc error: code = NotFound desc = could not find container \"50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56\": container with ID starting with 50f53b818d43e88e1164b6b6bbf0ca652d2e3693abf162d8e46cdd3745bd9b56 not found: ID does not exist"
Sep 06 01:24:59.375843 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.375825    2557 scope.go:117] "RemoveContainer" containerID="7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"
Sep 06 01:24:59.376113 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:24:59.376083    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a\": container with ID starting with 7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a not found: ID does not exist" containerID="7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"
Sep 06 01:24:59.376178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.376129    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a"} err="failed to get container status \"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a\": rpc error: code = NotFound desc = could not find container \"7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a\": container with ID starting with 7aa86bed5ae0f849d4b4024d0038640a9a4c233681ebf638f1bd0971b6d1b70a not found: ID does not exist"
Sep 06 01:24:59.397396 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.397358    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:24:59.399642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:24:59.399618    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-b63fa0-openshift-default-5d9cffd654-2cd4g"]
Sep 06 01:25:00.171268 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:00.171224    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" path="/var/lib/kubelet/pods/32e640c0-7b8b-4d8e-a09b-9169bb60ae51/volumes"
Sep 06 01:25:01.498392 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.498361    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:01.498942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.498921    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.499041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.498946    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.499041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.498976    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.499041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.498985    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.499240 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.499090    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.499240 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.499124    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="32e640c0-7b8b-4d8e-a09b-9169bb60ae51" containerName="istio-proxy"
Sep 06 01:25:01.503890 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.503861    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.506474 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.506443    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f2686adc-serving-cert\""
Sep 06 01:25:01.513085 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.513062    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:01.579280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.579249    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.579445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.579316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgh6x\" (UniqueName: \"kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.579445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.579389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.680146 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.680095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.680317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.680217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.680386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.680317    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgh6x\" (UniqueName: \"kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.681025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.680983    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.683550 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.683491    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.689178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.689148    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgh6x\" (UniqueName: \"kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x\") pod \"maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:01.817335 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:01.817253    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:02.107831 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:02.107804    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:02.110119 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:02.110075    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9937b4b_a675_4d1a_9e6b_458596ed0073.slice/crio-20fd9c645ab4235ef8ebc987a857e526a00570620301fab390eaacd9e4c0ccd0 WatchSource:0}: Error finding container 20fd9c645ab4235ef8ebc987a857e526a00570620301fab390eaacd9e4c0ccd0: Status 404 returned error can't find the container with id 20fd9c645ab4235ef8ebc987a857e526a00570620301fab390eaacd9e4c0ccd0
Sep 06 01:25:02.379558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:02.379470    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" event={"ID":"b9937b4b-a675-4d1a-9e6b-458596ed0073","Type":"ContainerStarted","Data":"20fd9c645ab4235ef8ebc987a857e526a00570620301fab390eaacd9e4c0ccd0"}
Sep 06 01:25:03.387333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:03.387294    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" event={"ID":"b9937b4b-a675-4d1a-9e6b-458596ed0073","Type":"ContainerStarted","Data":"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"}
Sep 06 01:25:03.387784 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:03.387360    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:03.407059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:03.407015    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" podStartSLOduration=1.855312125 podStartE2EDuration="2.406997332s" totalImagesPullingTime="551.685207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:03.405695778 +0000 UTC m=+971.731115773" watchObservedRunningTime="2026-09-06 01:25:03.406997332 +0000 UTC m=+971.732417309"
Sep 06 01:25:05.037572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.037534    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:25:05.038012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.037762    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" podUID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" containerName="maas-api" containerID="cri-o://00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce" gracePeriod=30
Sep 06 01:25:05.307297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.307273    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:25:05.400905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.400867    2557 generic.go:356] "Generic (PLEG): container finished" podID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" containerID="00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce" exitCode=0
Sep 06 01:25:05.401097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.400961    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" event={"ID":"15fa17e3-c289-43d7-b2c0-3c4db19be9da","Type":"ContainerDied","Data":"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"}
Sep 06 01:25:05.401097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.401001    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd" event={"ID":"15fa17e3-c289-43d7-b2c0-3c4db19be9da","Type":"ContainerDied","Data":"9c8da41a93f9609db7034789a8569c3fc75ab35c65c7e12929b418ba78bafb61"}
Sep 06 01:25:05.401097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.401024    2557 scope.go:117] "RemoveContainer" containerID="00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"
Sep 06 01:25:05.401332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.401190    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"
Sep 06 01:25:05.412516 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.412495    2557 scope.go:117] "RemoveContainer" containerID="00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"
Sep 06 01:25:05.412728 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.412705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca\") pod \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") "
Sep 06 01:25:05.412832 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:05.412804    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce\": container with ID starting with 00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce not found: ID does not exist" containerID="00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"
Sep 06 01:25:05.412918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.412842    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") pod \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") "
Sep 06 01:25:05.412918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.412849    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce"} err="failed to get container status \"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce\": rpc error: code = NotFound desc = could not find container \"00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce\": container with ID starting with 00a226d54a2f4345fd1d2c5d6c8d6b7963e46a324ee1646d800ca2c1eabce9ce not found: ID does not exist"
Sep 06 01:25:05.412918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.412891    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlnw2\" (UniqueName: \"kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2\") pod \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\" (UID: \"15fa17e3-c289-43d7-b2c0-3c4db19be9da\") "
Sep 06 01:25:05.413134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.413089    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15fa17e3-c289-43d7-b2c0-3c4db19be9da" (UID: "15fa17e3-c289-43d7-b2c0-3c4db19be9da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:05.415202 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.415175    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15fa17e3-c289-43d7-b2c0-3c4db19be9da" (UID: "15fa17e3-c289-43d7-b2c0-3c4db19be9da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:05.415430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.415396    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2" (OuterVolumeSpecName: "kube-api-access-vlnw2") pod "15fa17e3-c289-43d7-b2c0-3c4db19be9da" (UID: "15fa17e3-c289-43d7-b2c0-3c4db19be9da"). InnerVolumeSpecName "kube-api-access-vlnw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:05.514526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.514495    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15fa17e3-c289-43d7-b2c0-3c4db19be9da-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.514526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.514521    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlnw2\" (UniqueName: \"kubernetes.io/projected/15fa17e3-c289-43d7-b2c0-3c4db19be9da-kube-api-access-vlnw2\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.514698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.514537    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15fa17e3-c289-43d7-b2c0-3c4db19be9da-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:05.725618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.725578    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:25:05.729560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:05.729528    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-4b217a-574fd6dd49-j2dgd"]
Sep 06 01:25:06.168352 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:06.168252    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" path="/var/lib/kubelet/pods/15fa17e3-c289-43d7-b2c0-3c4db19be9da/volumes"
Sep 06 01:25:09.398234 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:09.398202    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:11.728058 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:11.727959    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:25:11.734838 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:11.734800    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy" containerID="cri-o://3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14" gracePeriod=30
Sep 06 01:25:12.605410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.605370    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:25:12.605980 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.605962    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" containerName="maas-api"
Sep 06 01:25:12.605980 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.605982    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" containerName="maas-api"
Sep 06 01:25:12.606092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.606069    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="15fa17e3-c289-43d7-b2c0-3c4db19be9da" containerName="maas-api"
Sep 06 01:25:12.610751 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.610722    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.613121 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.613084    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-5833d5-openshift-default-dockercfg-6pbtv\""
Sep 06 01:25:12.621242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.621213    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:25:12.687177 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2mj5\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687207    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687300    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687363    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687477    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.687539 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.687493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788549    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788656    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2mj5\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788715    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788758    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.788950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.788908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.789536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.789159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.789536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.789372    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.789536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.789424    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.789688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.789612    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.791355 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.791327    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.791538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.791518    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.796759 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.796733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2mj5\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.796759 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.796752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token\") pod \"e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") " pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:12.925444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:12.925355    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:13.202918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.202886    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:25:13.204757 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:13.204717    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7896b18_7623_4ad4_87d4_5af6e5fd0678.slice/crio-4fc2ffaa2a1bfa8313ec8268ab93f22160c1b6734b20d64b4ccc7f414beafd0c WatchSource:0}: Error finding container 4fc2ffaa2a1bfa8313ec8268ab93f22160c1b6734b20d64b4ccc7f414beafd0c: Status 404 returned error can't find the container with id 4fc2ffaa2a1bfa8313ec8268ab93f22160c1b6734b20d64b4ccc7f414beafd0c
Sep 06 01:25:13.207246 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.207212    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:13.207342 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.207274    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:13.207342 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.207302    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:13.446948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.446013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerStarted","Data":"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"}
Sep 06 01:25:13.446948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.446080    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerStarted","Data":"4fc2ffaa2a1bfa8313ec8268ab93f22160c1b6734b20d64b4ccc7f414beafd0c"}
Sep 06 01:25:13.467188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.467066    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podStartSLOduration=1.467051204 podStartE2EDuration="1.467051204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:13.46557309 +0000 UTC m=+981.790993067" watchObservedRunningTime="2026-09-06 01:25:13.467051204 +0000 UTC m=+981.792471181"
Sep 06 01:25:13.926259 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:13.926177    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:14.714480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:14.713276    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:39094->10.132.0.70:15021: read: connection reset by peer" start-of-body=
Sep 06 01:25:14.714480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:14.713331    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:39094->10.132.0.70:15021: read: connection reset by peer"
Sep 06 01:25:14.931334 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:14.931254    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:15.459587 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.459556    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerID="9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e" exitCode=0
Sep 06 01:25:15.459761 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.459628    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerDied","Data":"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"}
Sep 06 01:25:15.459915 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.459897    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:15.460088 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.460068    2557 scope.go:117] "RemoveContainer" containerID="9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"
Sep 06 01:25:15.460955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.460833    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:15.461322 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.461293    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:15.461446 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.461383    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:15.461446 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:15.461429    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:16.472019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.471966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerStarted","Data":"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"}
Sep 06 01:25:16.628270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.628234    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:25:16.632118 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.632081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.634386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.634363    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-5833d5-serving-cert\""
Sep 06 01:25:16.643115 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.643069    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:25:16.730436 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.730353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.730583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.730442    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.730583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.730560    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvwfx\" (UniqueName: \"kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.831721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.831687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.831892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.831737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.831892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.831802    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvwfx\" (UniqueName: \"kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.831892 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:16.831841    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-serving-cert: secret "maas-api-e2e-shared-a-w3-5833d5-serving-cert" not found
Sep 06 01:25:16.832013 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:16.831919    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls podName:64da895e-044c-4fa9-abb3-a92525f78537 nodeName:}" failed. No retries permitted until 2026-09-06 01:25:17.331902482 +0000 UTC m=+985.657322437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls") pod "maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" (UID: "64da895e-044c-4fa9-abb3-a92525f78537") : secret "maas-api-e2e-shared-a-w3-5833d5-serving-cert" not found
Sep 06 01:25:16.832821 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.832801    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:16.857404 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:16.857368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvwfx\" (UniqueName: \"kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:17.028470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.028440    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:25:17.096563 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.096525    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:17.096860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.096811    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 06 01:25:17.096962 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.096892    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 06 01:25:17.133929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.133896    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.133929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.133934    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.133951    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.133981    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zrkb\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134075    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134165    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134203    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data" (OuterVolumeSpecName: "istio-data") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:17.134470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134227    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:17.134470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134271    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket\") pod \"e274de59-4d65-4259-82a3-97db8857521a\" (UID: \"e274de59-4d65-4259-82a3-97db8857521a\") "
Sep 06 01:25:17.134470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134430    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:17.134739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134565    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:17.134739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134612    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:17.134739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134718    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.134902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134739    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.134902 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.134754    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.136404 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.136378    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token" (OuterVolumeSpecName: "istio-token") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:17.136531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.136442    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb" (OuterVolumeSpecName: "kube-api-access-7zrkb") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "kube-api-access-7zrkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:17.136577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.136531    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:25:17.136577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.136552    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e274de59-4d65-4259-82a3-97db8857521a" (UID: "e274de59-4d65-4259-82a3-97db8857521a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:17.236008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.235970    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e274de59-4d65-4259-82a3-97db8857521a-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.236008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.236009    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e274de59-4d65-4259-82a3-97db8857521a-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.236283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.236023    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.236283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.236036    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.236283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.236052    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e274de59-4d65-4259-82a3-97db8857521a-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.236283 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.236065    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zrkb\" (UniqueName: \"kubernetes.io/projected/e274de59-4d65-4259-82a3-97db8857521a-kube-api-access-7zrkb\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:17.337289 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.337192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:17.339605 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.339578    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:17.484992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.484958    2557 generic.go:356] "Generic (PLEG): container finished" podID="e274de59-4d65-4259-82a3-97db8857521a" containerID="3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14" exitCode=0
Sep 06 01:25:17.485497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.485005    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"
Sep 06 01:25:17.485497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.485086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerDied","Data":"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"}
Sep 06 01:25:17.485497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.485184    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr" event={"ID":"e274de59-4d65-4259-82a3-97db8857521a","Type":"ContainerDied","Data":"5c2fa32a06a32947399d92fbc7661b68ac06bef334449205cc7881094f5843f7"}
Sep 06 01:25:17.485497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.485217    2557 scope.go:117] "RemoveContainer" containerID="3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"
Sep 06 01:25:17.495593 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.495576    2557 scope.go:117] "RemoveContainer" containerID="d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"
Sep 06 01:25:17.503687 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.503665    2557 scope.go:117] "RemoveContainer" containerID="3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"
Sep 06 01:25:17.503967 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:17.503949    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14\": container with ID starting with 3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14 not found: ID does not exist" containerID="3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"
Sep 06 01:25:17.504038 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.503975    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14"} err="failed to get container status \"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14\": rpc error: code = NotFound desc = could not find container \"3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14\": container with ID starting with 3a799ccc3d689d8aca3cc348f63fc0c131f3aa653e3020a057777350e4a00d14 not found: ID does not exist"
Sep 06 01:25:17.504038 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.503993    2557 scope.go:117] "RemoveContainer" containerID="d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"
Sep 06 01:25:17.504313 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:17.504289    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa\": container with ID starting with d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa not found: ID does not exist" containerID="d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"
Sep 06 01:25:17.504419 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.504318    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa"} err="failed to get container status \"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa\": rpc error: code = NotFound desc = could not find container \"d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa\": container with ID starting with d0ffc006be3af0c7866fcf98f9ee50ba289bedea7ed92e3b2e723bb0c323b5aa not found: ID does not exist"
Sep 06 01:25:17.518575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.507755    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:25:17.518575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.518414    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-4b217a-openshift-default-59d45cd47d-rdsxr"]
Sep 06 01:25:17.542949 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.542683    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:17.827399 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.827371    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:25:17.829980 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:17.829948    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64da895e_044c_4fa9_abb3_a92525f78537.slice/crio-5eea4b5b716f8ab9e35ef738559f2d4ec55ff61e2afab24c71867dea1be9f29e WatchSource:0}: Error finding container 5eea4b5b716f8ab9e35ef738559f2d4ec55ff61e2afab24c71867dea1be9f29e: Status 404 returned error can't find the container with id 5eea4b5b716f8ab9e35ef738559f2d4ec55ff61e2afab24c71867dea1be9f29e
Sep 06 01:25:17.831625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:17.831603    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:25:18.097359 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.097321    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 06 01:25:18.097543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.097379    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 06 01:25:18.168501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.168463    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e274de59-4d65-4259-82a3-97db8857521a" path="/var/lib/kubelet/pods/e274de59-4d65-4259-82a3-97db8857521a/volumes"
Sep 06 01:25:18.494271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.494237    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" event={"ID":"64da895e-044c-4fa9-abb3-a92525f78537","Type":"ContainerStarted","Data":"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"}
Sep 06 01:25:18.494733 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.494307    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" event={"ID":"64da895e-044c-4fa9-abb3-a92525f78537","Type":"ContainerStarted","Data":"5eea4b5b716f8ab9e35ef738559f2d4ec55ff61e2afab24c71867dea1be9f29e"}
Sep 06 01:25:18.494733 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.494348    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:18.510479 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:18.510427    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" podStartSLOduration=1.979654031 podStartE2EDuration="2.510412257s" totalImagesPullingTime="530.758226ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:18.509520947 +0000 UTC m=+986.834940923" watchObservedRunningTime="2026-09-06 01:25:18.510412257 +0000 UTC m=+986.835832234"
Sep 06 01:25:19.097473 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:19.097437    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 06 01:25:19.097634 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:19.097492    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 06 01:25:20.096999 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:20.096954    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 06 01:25:20.097497 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:20.097019    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 06 01:25:21.097225 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:21.097184    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Sep 06 01:25:21.097608 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:21.097242    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Sep 06 01:25:22.100722 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:22.100685    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:22.101137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:22.101117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:22.101659 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:22.101637    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:24.506448 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:24.506417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:25:26.564129 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.561372    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:25:26.564129 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.561646    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" podUID="1b16aac3-b7c4-4344-abef-98841fc3251c" containerName="maas-api" containerID="cri-o://2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab" gracePeriod=30
Sep 06 01:25:26.831692 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.831668    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:25:26.878127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.877438    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca\") pod \"1b16aac3-b7c4-4344-abef-98841fc3251c\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") "
Sep 06 01:25:26.878127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.877531    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqzx6\" (UniqueName: \"kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6\") pod \"1b16aac3-b7c4-4344-abef-98841fc3251c\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") "
Sep 06 01:25:26.878127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.877593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls\") pod \"1b16aac3-b7c4-4344-abef-98841fc3251c\" (UID: \"1b16aac3-b7c4-4344-abef-98841fc3251c\") "
Sep 06 01:25:26.878834 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.878546    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1b16aac3-b7c4-4344-abef-98841fc3251c" (UID: "1b16aac3-b7c4-4344-abef-98841fc3251c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:26.881142 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.880935    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1b16aac3-b7c4-4344-abef-98841fc3251c" (UID: "1b16aac3-b7c4-4344-abef-98841fc3251c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:26.881384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.881350    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6" (OuterVolumeSpecName: "kube-api-access-zqzx6") pod "1b16aac3-b7c4-4344-abef-98841fc3251c" (UID: "1b16aac3-b7c4-4344-abef-98841fc3251c"). InnerVolumeSpecName "kube-api-access-zqzx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:26.979097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.979059    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b16aac3-b7c4-4344-abef-98841fc3251c-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:26.979097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.979091    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqzx6\" (UniqueName: \"kubernetes.io/projected/1b16aac3-b7c4-4344-abef-98841fc3251c-kube-api-access-zqzx6\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:26.979097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:26.979128    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1b16aac3-b7c4-4344-abef-98841fc3251c-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:27.578406 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.578326    2557 generic.go:356] "Generic (PLEG): container finished" podID="1b16aac3-b7c4-4344-abef-98841fc3251c" containerID="2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab" exitCode=0
Sep 06 01:25:27.578916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.578412    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"
Sep 06 01:25:27.578916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.578421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" event={"ID":"1b16aac3-b7c4-4344-abef-98841fc3251c","Type":"ContainerDied","Data":"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"}
Sep 06 01:25:27.578916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.578522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h" event={"ID":"1b16aac3-b7c4-4344-abef-98841fc3251c","Type":"ContainerDied","Data":"077ff854ca387540b132d7e1c341091efaf81ce05aa41b5211aa82a8c9666608"}
Sep 06 01:25:27.578916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.578562    2557 scope.go:117] "RemoveContainer" containerID="2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"
Sep 06 01:25:27.588302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.588285    2557 scope.go:117] "RemoveContainer" containerID="2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"
Sep 06 01:25:27.588576 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:27.588556    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab\": container with ID starting with 2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab not found: ID does not exist" containerID="2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"
Sep 06 01:25:27.588655 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.588587    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab"} err="failed to get container status \"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab\": rpc error: code = NotFound desc = could not find container \"2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab\": container with ID starting with 2f3889dd14c64c5b055baa531b7a5de537092890d10897e03042ddcd13c8bbab not found: ID does not exist"
Sep 06 01:25:27.600386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.600363    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:25:27.603697 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:27.603680    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-109eb6-5c8688b44c-g7f7h"]
Sep 06 01:25:28.168207 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:28.168164    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b16aac3-b7c4-4344-abef-98841fc3251c" path="/var/lib/kubelet/pods/1b16aac3-b7c4-4344-abef-98841fc3251c/volumes"
Sep 06 01:25:31.502321 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:31.502274    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 01:25:31.502750 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:31.502334    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:25:32.609860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.609821    2557 generic.go:356] "Generic (PLEG): container finished" podID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerID="d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c" exitCode=0
Sep 06 01:25:32.610339 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.609894    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerDied","Data":"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"}
Sep 06 01:25:32.610339 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.610335    2557 scope.go:117] "RemoveContainer" containerID="d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"
Sep 06 01:25:32.611374 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.611346    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:32.611478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.611426    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:32.611559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:32.611473    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:33.618370 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:33.618340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerStarted","Data":"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"}
Sep 06 01:25:33.926328 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:33.926241    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:33.926485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:33.926434    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 06 01:25:33.926530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:33.926485    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 06 01:25:34.065196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.065156    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:25:34.065478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.065440    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy" containerID="cri-o://90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873" gracePeriod=30
Sep 06 01:25:34.847829 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.847781    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:25:34.859143 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859094    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.859351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859336    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.859459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859448    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b16aac3-b7c4-4344-abef-98841fc3251c" containerName="maas-api"
Sep 06 01:25:34.859541 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859531    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b16aac3-b7c4-4344-abef-98841fc3251c" containerName="maas-api"
Sep 06 01:25:34.859620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859610    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.859698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859689    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.859896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859883    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b16aac3-b7c4-4344-abef-98841fc3251c" containerName="maas-api"
Sep 06 01:25:34.859994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.859984    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.860078 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.860069    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e274de59-4d65-4259-82a3-97db8857521a" containerName="istio-proxy"
Sep 06 01:25:34.864945 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.864920    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.865898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.865881    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:25:34.872595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.872572    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-062abb-openshift-default-dockercfg-4t685\""
Sep 06 01:25:34.926729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.926699    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 06 01:25:34.926874 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.926744    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960579    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960625    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960681    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960725    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f22dk\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960757    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960897    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:34.962127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:34.960940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.061954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.061907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.061976    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f22dk\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062005    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062144    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062464 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062464 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062239    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062464 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062265    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062661    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.062798 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.062768    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.063288 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.063249    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.063582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.063556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.063753 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.063635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.068564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.068531    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.068721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.068698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.070882 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.070860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.071133 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.071096    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f22dk\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk\") pod \"e2e-noten-062abb-openshift-default-5c86445f74-xtq68\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") " pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.182552 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.182447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:35.470577 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.470381    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:25:35.472778 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:35.472749    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3818b439_f299_4938_80cf_279895623b7d.slice/crio-649f3b29278fe3869415ea5973fbae638c126f8ca54abd0b1a0dbac671b5e4ad WatchSource:0}: Error finding container 649f3b29278fe3869415ea5973fbae638c126f8ca54abd0b1a0dbac671b5e4ad: Status 404 returned error can't find the container with id 649f3b29278fe3869415ea5973fbae638c126f8ca54abd0b1a0dbac671b5e4ad
Sep 06 01:25:35.475044 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.475007    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:35.475147 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.475079    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:35.475147 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.475132    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:35.632351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.632311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" event={"ID":"3818b439-f299-4938-80cf-279895623b7d","Type":"ContainerStarted","Data":"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"}
Sep 06 01:25:35.632529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.632371    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" event={"ID":"3818b439-f299-4938-80cf-279895623b7d","Type":"ContainerStarted","Data":"649f3b29278fe3869415ea5973fbae638c126f8ca54abd0b1a0dbac671b5e4ad"}
Sep 06 01:25:35.652560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.652483    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" podStartSLOduration=1.652459548 podStartE2EDuration="1.652459548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:35.649868668 +0000 UTC m=+1003.975288645" watchObservedRunningTime="2026-09-06 01:25:35.652459548 +0000 UTC m=+1003.977879527"
Sep 06 01:25:35.926718 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.926634    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 06 01:25:35.926718 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:35.926696    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 06 01:25:36.182828 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:36.182747    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:36.184404 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:36.184379    2557 patch_prober.go:28] interesting pod/e2e-noten-062abb-openshift-default-5c86445f74-xtq68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 06 01:25:36.184547 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:36.184434    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 06 01:25:36.925937 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:36.925893    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 06 01:25:36.926289 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:36.925964    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 06 01:25:37.187540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:37.187462    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:37.647262 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:37.647230    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:37.651583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:37.651551    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:25:37.926274 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:37.926182    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 06 01:25:37.926274 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:37.926246    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 06 01:25:38.974852 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:38.974821    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:38.975322 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:38.975304    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:38.976772 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:38.976750    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:25:39.330865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.330840    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:25:39.409689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409661    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.409865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409723    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxjqh\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.409865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409748    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.409865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409772    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.409865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409805    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.409865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409842    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.410282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409872    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.410282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409898    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.410282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409955    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs\") pod \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\" (UID: \"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8\") "
Sep 06 01:25:39.410282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.409964    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:39.410282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410073    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:39.410543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410245    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:39.410543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410327    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.410543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410316    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:39.410543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410351    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.410707 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.410607    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:39.412040 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.412013    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh" (OuterVolumeSpecName: "kube-api-access-hxjqh") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "kube-api-access-hxjqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:39.412154 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.412053    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:39.412287 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.412268    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:39.412396 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.412375    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" (UID: "1e0f36b2-c857-4bc1-b275-448fdfd3c3a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511395    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxjqh\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-kube-api-access-hxjqh\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511420    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511430    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511437    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511446    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511453    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.511468 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.511462    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:39.660151 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.660093    2557 generic.go:356] "Generic (PLEG): container finished" podID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerID="90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873" exitCode=0
Sep 06 01:25:39.660300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.660162    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"
Sep 06 01:25:39.660300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.660173    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerDied","Data":"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"}
Sep 06 01:25:39.660300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.660229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb" event={"ID":"1e0f36b2-c857-4bc1-b275-448fdfd3c3a8","Type":"ContainerDied","Data":"64adf52d75ae85728f9f3ed5530dc635b6480c5b86f1acb8e1570af1b1a87ba9"}
Sep 06 01:25:39.660300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.660251    2557 scope.go:117] "RemoveContainer" containerID="90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"
Sep 06 01:25:39.669987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.669969    2557 scope.go:117] "RemoveContainer" containerID="27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"
Sep 06 01:25:39.678615 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.678600    2557 scope.go:117] "RemoveContainer" containerID="90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"
Sep 06 01:25:39.678877 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:39.678857    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873\": container with ID starting with 90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873 not found: ID does not exist" containerID="90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"
Sep 06 01:25:39.678942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.678884    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873"} err="failed to get container status \"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873\": rpc error: code = NotFound desc = could not find container \"90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873\": container with ID starting with 90e13770b52bb481dba67115973de298c93a77831cc0add679c1abe46275f873 not found: ID does not exist"
Sep 06 01:25:39.678942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.678900    2557 scope.go:117] "RemoveContainer" containerID="27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"
Sep 06 01:25:39.679174 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:39.679150    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb\": container with ID starting with 27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb not found: ID does not exist" containerID="27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"
Sep 06 01:25:39.679260 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.679181    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb"} err="failed to get container status \"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb\": rpc error: code = NotFound desc = could not find container \"27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb\": container with ID starting with 27e8db80fbee47176a2b228344762bebdcb56f892540473f6ee800b9b83981eb not found: ID does not exist"
Sep 06 01:25:39.681893 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.681872    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:25:39.685453 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:39.685433    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-109eb6-openshift-default-767c6d87d8-h5zbb"]
Sep 06 01:25:40.165595 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.165565    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" path="/var/lib/kubelet/pods/1e0f36b2-c857-4bc1-b275-448fdfd3c3a8/volumes"
Sep 06 01:25:40.956301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956272    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:25:40.956777 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956759    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.956823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956780    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.956823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956795    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.956823 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956800    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.956920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956868    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.956920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.956879    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e0f36b2-c857-4bc1-b275-448fdfd3c3a8" containerName="istio-proxy"
Sep 06 01:25:40.961303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.961280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:40.964892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.964871    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-41f259-openshift-default-dockercfg-rlrvs\""
Sep 06 01:25:40.980046 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:40.974498    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:25:41.025937 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.025902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.025937 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.025936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.025959    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.025980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.026036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.026073    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h6xd\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.026090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026336 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.026206    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.026336 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.026238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.126790 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.126790 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126791    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126811    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h6xd\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126943    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.126979    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.127481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127449    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.128126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.127664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.129298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.129271    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.129298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.129282    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.134905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.134881    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.134990 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.134955    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h6xd\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd\") pod \"e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") " pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.273575 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.273489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:41.552055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.552032    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:25:41.554856 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:41.554832    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c69fbb_5c8c_4baa_8825_2a6ab6f949c8.slice/crio-d39c32d7e0077ddb15aca87877318563486ee37d1c52b0b9e69b33a4dfa84556 WatchSource:0}: Error finding container d39c32d7e0077ddb15aca87877318563486ee37d1c52b0b9e69b33a4dfa84556: Status 404 returned error can't find the container with id d39c32d7e0077ddb15aca87877318563486ee37d1c52b0b9e69b33a4dfa84556
Sep 06 01:25:41.556898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.556868    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:41.556973 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.556948    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:41.557021 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.556977    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:41.675052 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.675010    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerStarted","Data":"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"}
Sep 06 01:25:41.675234 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.675061    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerStarted","Data":"d39c32d7e0077ddb15aca87877318563486ee37d1c52b0b9e69b33a4dfa84556"}
Sep 06 01:25:41.697584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:41.697391    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podStartSLOduration=1.697369804 podStartE2EDuration="1.697369804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:41.69550269 +0000 UTC m=+1010.020922668" watchObservedRunningTime="2026-09-06 01:25:41.697369804 +0000 UTC m=+1010.022789782"
Sep 06 01:25:42.274596 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:42.274562    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:42.279597 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:42.279572    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:42.680222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:42.680139    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:42.681449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:42.681421    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:25:43.247845 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.247805    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:43.248303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.248272    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" podUID="b9937b4b-a675-4d1a-9e6b-458596ed0073" containerName="maas-api" containerID="cri-o://d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294" gracePeriod=30
Sep 06 01:25:43.491873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.491847    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:43.552077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.551231    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls\") pod \"b9937b4b-a675-4d1a-9e6b-458596ed0073\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") "
Sep 06 01:25:43.552077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.551333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgh6x\" (UniqueName: \"kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x\") pod \"b9937b4b-a675-4d1a-9e6b-458596ed0073\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") "
Sep 06 01:25:43.552077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.551401    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca\") pod \"b9937b4b-a675-4d1a-9e6b-458596ed0073\" (UID: \"b9937b4b-a675-4d1a-9e6b-458596ed0073\") "
Sep 06 01:25:43.552837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.552536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9937b4b-a675-4d1a-9e6b-458596ed0073" (UID: "b9937b4b-a675-4d1a-9e6b-458596ed0073"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:43.555239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.555208    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9937b4b-a675-4d1a-9e6b-458596ed0073" (UID: "b9937b4b-a675-4d1a-9e6b-458596ed0073"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:25:43.555818 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.555794    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x" (OuterVolumeSpecName: "kube-api-access-rgh6x") pod "b9937b4b-a675-4d1a-9e6b-458596ed0073" (UID: "b9937b4b-a675-4d1a-9e6b-458596ed0073"). InnerVolumeSpecName "kube-api-access-rgh6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:43.652938 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.652901    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9937b4b-a675-4d1a-9e6b-458596ed0073-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.652938 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.652929    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgh6x\" (UniqueName: \"kubernetes.io/projected/b9937b4b-a675-4d1a-9e6b-458596ed0073-kube-api-access-rgh6x\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.652938 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.652938    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9937b4b-a675-4d1a-9e6b-458596ed0073-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:43.687222 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.687186    2557 generic.go:356] "Generic (PLEG): container finished" podID="b9937b4b-a675-4d1a-9e6b-458596ed0073" containerID="d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294" exitCode=0
Sep 06 01:25:43.687380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.687234    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"
Sep 06 01:25:43.687380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.687276    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" event={"ID":"b9937b4b-a675-4d1a-9e6b-458596ed0073","Type":"ContainerDied","Data":"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"}
Sep 06 01:25:43.687380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.687328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm" event={"ID":"b9937b4b-a675-4d1a-9e6b-458596ed0073","Type":"ContainerDied","Data":"20fd9c645ab4235ef8ebc987a857e526a00570620301fab390eaacd9e4c0ccd0"}
Sep 06 01:25:43.687380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.687357    2557 scope.go:117] "RemoveContainer" containerID="d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"
Sep 06 01:25:43.700017 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.700000    2557 scope.go:117] "RemoveContainer" containerID="d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"
Sep 06 01:25:43.700316 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:43.700295    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294\": container with ID starting with d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294 not found: ID does not exist" containerID="d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"
Sep 06 01:25:43.700390 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.700328    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294"} err="failed to get container status \"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294\": rpc error: code = NotFound desc = could not find container \"d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294\": container with ID starting with d33d177c62e760217a3ae6cd5569208c6b947bb328346e517ca9ed9f54619294 not found: ID does not exist"
Sep 06 01:25:43.708830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.708807    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:43.714488 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:43.714467    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f2686adc-77b56d96f-8ktgm"]
Sep 06 01:25:44.163571 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.163538    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9937b4b-a675-4d1a-9e6b-458596ed0073" path="/var/lib/kubelet/pods/b9937b4b-a675-4d1a-9e6b-458596ed0073/volumes"
Sep 06 01:25:44.744853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.739335    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:25:44.744853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.740228    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9937b4b-a675-4d1a-9e6b-458596ed0073" containerName="maas-api"
Sep 06 01:25:44.744853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.740249    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9937b4b-a675-4d1a-9e6b-458596ed0073" containerName="maas-api"
Sep 06 01:25:44.744853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.740426    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9937b4b-a675-4d1a-9e6b-458596ed0073" containerName="maas-api"
Sep 06 01:25:44.747439 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.747413    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.750483 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.750445    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-41f259-serving-cert\""
Sep 06 01:25:44.751484 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.751260    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:25:44.866028 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.865997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.866225 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.866043    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.866225 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.866081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvk88\" (UniqueName: \"kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.967209 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.967170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvk88\" (UniqueName: \"kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.967409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.967327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.967409 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.967380    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.967536 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:44.967516    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-serving-cert: secret "maas-api-e2e-shared-b-w3-41f259-serving-cert" not found
Sep 06 01:25:44.967599 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:44.967577    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls podName:12f5744e-e431-404f-8b7f-7efe8b94507a nodeName:}" failed. No retries permitted until 2026-09-06 01:25:45.467556468 +0000 UTC m=+1013.792976422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls") pod "maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" (UID: "12f5744e-e431-404f-8b7f-7efe8b94507a") : secret "maas-api-e2e-shared-b-w3-41f259-serving-cert" not found
Sep 06 01:25:44.968152 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.968129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:44.976485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:44.976454    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvk88\" (UniqueName: \"kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:45.471942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:45.471900    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:45.474483 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:45.474445    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:45.660809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:45.660778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:45.933305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:45.933278    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:25:45.935698 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:25:45.935668    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f5744e_e431_404f_8b7f_7efe8b94507a.slice/crio-54432dc5dc48d684e7368535c14289d8a29255dcabe0a8a98ec822a8d6eeb516 WatchSource:0}: Error finding container 54432dc5dc48d684e7368535c14289d8a29255dcabe0a8a98ec822a8d6eeb516: Status 404 returned error can't find the container with id 54432dc5dc48d684e7368535c14289d8a29255dcabe0a8a98ec822a8d6eeb516
Sep 06 01:25:46.706470 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:46.706429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" event={"ID":"12f5744e-e431-404f-8b7f-7efe8b94507a","Type":"ContainerStarted","Data":"56a7c2403f36dd2018da15f9cd4ffd8888f73d7d8e6820740fc82b17e2ff1ae6"}
Sep 06 01:25:46.706652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:46.706488    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" event={"ID":"12f5744e-e431-404f-8b7f-7efe8b94507a","Type":"ContainerStarted","Data":"54432dc5dc48d684e7368535c14289d8a29255dcabe0a8a98ec822a8d6eeb516"}
Sep 06 01:25:46.706652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:46.706580    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:46.725642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:46.725601    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" podStartSLOduration=2.412509197 podStartE2EDuration="2.725587452s" totalImagesPullingTime="313.078255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:25:46.723639308 +0000 UTC m=+1015.049059284" watchObservedRunningTime="2026-09-06 01:25:46.725587452 +0000 UTC m=+1015.051007429"
Sep 06 01:25:50.071094 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:50.063915    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:25:50.071094 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:50.064228    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" containerID="cri-o://7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379" gracePeriod=30
Sep 06 01:25:52.103572 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:52.103536    2557 patch_prober.go:28] interesting pod/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:25:52.104028 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:52.103612    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:25:52.717645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:52.717607    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:25:55.351073 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.351013    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:55.476803 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476771    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72gkc\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.476941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476824    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.476941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476843    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.476941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476868    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.476941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476912    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.476941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476934    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.477247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476969    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.477247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.476999    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.477247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477082    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data\") pod \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\" (UID: \"8ede90f5-510a-41b0-98c5-f88c57e5bd38\") "
Sep 06 01:25:55.477404 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477364    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:55.477601 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477577    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:55.477783 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477590    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:55.477783 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477721    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:55.477783 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.477729    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:25:55.479258 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.479225    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:25:55.479465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.479443    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:55.479558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.479531    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:25:55.479651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.479630    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc" (OuterVolumeSpecName: "kube-api-access-72gkc") pod "8ede90f5-510a-41b0-98c5-f88c57e5bd38" (UID: "8ede90f5-510a-41b0-98c5-f88c57e5bd38"). InnerVolumeSpecName "kube-api-access-72gkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:25:55.578282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578249    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578278    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578282 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578286    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578295    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578303    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578311    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578320    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578328    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ede90f5-510a-41b0-98c5-f88c57e5bd38-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.578507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.578336    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72gkc\" (UniqueName: \"kubernetes.io/projected/8ede90f5-510a-41b0-98c5-f88c57e5bd38-kube-api-access-72gkc\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:25:55.780174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.780133    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerID="7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379" exitCode=0
Sep 06 01:25:55.780340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.780178    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerDied","Data":"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"}
Sep 06 01:25:55.780340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.780196    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"
Sep 06 01:25:55.780340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.780249    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5" event={"ID":"8ede90f5-510a-41b0-98c5-f88c57e5bd38","Type":"ContainerDied","Data":"e162d6cf7e6a6d21a5d708a86da97e11018e9abd842cf350d6339787ed3c53a0"}
Sep 06 01:25:55.780340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.780280    2557 scope.go:117] "RemoveContainer" containerID="7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"
Sep 06 01:25:55.790404 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.790386    2557 scope.go:117] "RemoveContainer" containerID="9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"
Sep 06 01:25:55.798594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.798577    2557 scope.go:117] "RemoveContainer" containerID="7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"
Sep 06 01:25:55.798861 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:55.798842    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379\": container with ID starting with 7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379 not found: ID does not exist" containerID="7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"
Sep 06 01:25:55.798919 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.798867    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379"} err="failed to get container status \"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379\": rpc error: code = NotFound desc = could not find container \"7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379\": container with ID starting with 7cc1a21b7cd832064107363a9221fd5ac6262c6d7a9ab7164a15ecef1f380379 not found: ID does not exist"
Sep 06 01:25:55.798919 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.798885    2557 scope.go:117] "RemoveContainer" containerID="9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"
Sep 06 01:25:55.799162 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:25:55.799137    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e\": container with ID starting with 9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e not found: ID does not exist" containerID="9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"
Sep 06 01:25:55.799209 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.799171    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e"} err="failed to get container status \"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e\": rpc error: code = NotFound desc = could not find container \"9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e\": container with ID starting with 9e51163974c875b6e5d708095b4fb1000bdefc8fb9a580bd85fdc46bf1c4aa4e not found: ID does not exist"
Sep 06 01:25:55.803064 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.803042    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:25:55.809623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:55.809599    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f2686adc-openshift-default-b96b784bd-4nnq5"]
Sep 06 01:25:56.164621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:56.164544    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" path="/var/lib/kubelet/pods/8ede90f5-510a-41b0-98c5-f88c57e5bd38/volumes"
Sep 06 01:25:58.508234 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.507367    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": read tcp 10.132.0.2:39484->10.132.0.75:15021: read: connection reset by peer" start-of-body=
Sep 06 01:25:58.508234 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.507435    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": read tcp 10.132.0.2:39484->10.132.0.75:15021: read: connection reset by peer"
Sep 06 01:25:58.799502 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.799412    2557 generic.go:356] "Generic (PLEG): container finished" podID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerID="4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb" exitCode=0
Sep 06 01:25:58.799502 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.799487    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerDied","Data":"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"}
Sep 06 01:25:58.799953 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.799931    2557 scope.go:117] "RemoveContainer" containerID="4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"
Sep 06 01:25:58.801055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.801027    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:58.801140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.801093    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:58.801191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:58.801143    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:25:59.807249 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:25:59.807213    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerStarted","Data":"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"}
Sep 06 01:26:00.274076 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:00.274037    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:26:00.274363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:00.274341    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 06 01:26:00.274424 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:00.274388    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 06 01:26:01.274217 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:01.274171    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 06 01:26:01.274689 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:01.274238    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 06 01:26:02.274444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:02.274409    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 06 01:26:02.274830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:02.274471    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 06 01:26:03.274190 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.274156    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 06 01:26:03.274376 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.274215    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 06 01:26:03.680884 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.680798    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:26:03.681347 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.681328    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:03.681433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.681351    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:03.681496 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.681478    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:03.681496 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.681489    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:03.685725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.685703    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.688400 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.688381    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-49c9de-openshift-default-dockercfg-7tkhd\""
Sep 06 01:26:03.696522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.696494    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762541    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762673    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762711    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx2mh\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.763126 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.762902    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863740    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863780    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx2mh\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863826    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863944    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.863976    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.864012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.864558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.864046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.865753 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.865707    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.865856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.865825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.866705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.866377    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.866705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.866571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.866705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.866652    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.867772 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.867746    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.868197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.868170    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.874631 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.874605    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.874737 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.874719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx2mh\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh\") pod \"e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") " pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:03.997621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:03.997421    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:04.274804 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.274709    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 06 01:26:04.274804 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.274760    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 06 01:26:04.300842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.300814    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:26:04.302341 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:26:04.302310    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aedda1c_de6e_4f3e_86da_675900857982.slice/crio-1d72738ba981d42d172174481997c1205e329562800656846d2a6ac8fec44209 WatchSource:0}: Error finding container 1d72738ba981d42d172174481997c1205e329562800656846d2a6ac8fec44209: Status 404 returned error can't find the container with id 1d72738ba981d42d172174481997c1205e329562800656846d2a6ac8fec44209
Sep 06 01:26:04.304651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.304619    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:04.304740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.304684    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:04.304740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.304712    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:04.835669 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.835631    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerStarted","Data":"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"}
Sep 06 01:26:04.836059 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.835696    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerStarted","Data":"1d72738ba981d42d172174481997c1205e329562800656846d2a6ac8fec44209"}
Sep 06 01:26:04.860703 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.860639    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podStartSLOduration=1.860617463 podStartE2EDuration="1.860617463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:04.858428924 +0000 UTC m=+1033.183848914" watchObservedRunningTime="2026-09-06 01:26:04.860617463 +0000 UTC m=+1033.186037441"
Sep 06 01:26:04.998550 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:04.998508    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:05.030164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:05.030124    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:26:05.030412 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:05.030366    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy" containerID="cri-o://d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f" gracePeriod=30
Sep 06 01:26:05.277279 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:05.277251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:26:05.277543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:05.277524    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:26:05.278300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:05.278281    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:26:06.003459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:06.003429    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:06.848072 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:06.848038    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:06.849574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:06.849543    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:07.649158 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:07.649116    2557 patch_prober.go:28] interesting pod/e2e-noten-062abb-openshift-default-5c86445f74-xtq68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:26:07.649621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:07.649195    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:26:08.036900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.036866    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:26:08.037321 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.037304    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:08.037386 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.037323    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ede90f5-510a-41b0-98c5-f88c57e5bd38" containerName="istio-proxy"
Sep 06 01:26:08.040704 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.040679    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.043273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.043253    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-49c9de-serving-cert\""
Sep 06 01:26:08.051490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.051460    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:26:08.112300 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.112265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqwz\" (UniqueName: \"kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.112480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.112323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.112480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.112393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.213733 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.213691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.213927 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.213847    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.214005 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.213994    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqwz\" (UniqueName: \"kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.214061 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:26:08.213996    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-serving-cert: secret "maas-api-e2e-shared-a-w2-49c9de-serving-cert" not found
Sep 06 01:26:08.214164 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:26:08.214137    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls podName:c2b30e2a-0788-49cf-96a6-948351b7e084 nodeName:}" failed. No retries permitted until 2026-09-06 01:26:08.714085961 +0000 UTC m=+1037.039505921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls") pod "maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" (UID: "c2b30e2a-0788-49cf-96a6-948351b7e084") : secret "maas-api-e2e-shared-a-w2-49c9de-serving-cert" not found
Sep 06 01:26:08.214462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.214431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.223077 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.223056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqwz\" (UniqueName: \"kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.718323 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.718285    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.720687 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.720667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:08.955835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:08.955792    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:09.230582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:09.230553    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:26:09.232343 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:26:09.232314    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2b30e2a_0788_49cf_96a6_948351b7e084.slice/crio-14dae84db070682bebf509ea1b63a5691297beb594a2cd95747ecd5deef5d1c3 WatchSource:0}: Error finding container 14dae84db070682bebf509ea1b63a5691297beb594a2cd95747ecd5deef5d1c3: Status 404 returned error can't find the container with id 14dae84db070682bebf509ea1b63a5691297beb594a2cd95747ecd5deef5d1c3
Sep 06 01:26:09.870494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:09.870399    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" event={"ID":"c2b30e2a-0788-49cf-96a6-948351b7e084","Type":"ContainerStarted","Data":"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"}
Sep 06 01:26:09.870824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:09.870502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" event={"ID":"c2b30e2a-0788-49cf-96a6-948351b7e084","Type":"ContainerStarted","Data":"14dae84db070682bebf509ea1b63a5691297beb594a2cd95747ecd5deef5d1c3"}
Sep 06 01:26:09.870824 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:09.870527    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:09.891794 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:09.891745    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" podStartSLOduration=1.573243704 podStartE2EDuration="1.891728822s" totalImagesPullingTime="318.485118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:09.889313002 +0000 UTC m=+1038.214732981" watchObservedRunningTime="2026-09-06 01:26:09.891728822 +0000 UTC m=+1038.217148799"
Sep 06 01:26:10.288642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.288613    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:26:10.336829 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.336798    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f22dk\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.336838    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.336877    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.336943    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.336980    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337004    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337038    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337074    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337127    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token\") pod \"3818b439-f299-4938-80cf-279895623b7d\" (UID: \"3818b439-f299-4938-80cf-279895623b7d\") "
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337189    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337240    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337392    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337487    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3818b439-f299-4938-80cf-279895623b7d-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337507    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337520    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.337620 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337520    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:10.338158 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.337647    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:10.339457 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.339429    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk" (OuterVolumeSpecName: "kube-api-access-f22dk") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "kube-api-access-f22dk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:26:10.339569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.339547    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:26:10.339692 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.339673    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:26:10.339805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.339786    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3818b439-f299-4938-80cf-279895623b7d" (UID: "3818b439-f299-4938-80cf-279895623b7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438554    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438595    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438604    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f22dk\" (UniqueName: \"kubernetes.io/projected/3818b439-f299-4938-80cf-279895623b7d-kube-api-access-f22dk\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438614    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438623    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3818b439-f299-4938-80cf-279895623b7d-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.438646 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.438631    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3818b439-f299-4938-80cf-279895623b7d-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:26:10.877127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.877074    2557 generic.go:356] "Generic (PLEG): container finished" podID="3818b439-f299-4938-80cf-279895623b7d" containerID="d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f" exitCode=0
Sep 06 01:26:10.877529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.877137    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"
Sep 06 01:26:10.877529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.877160    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" event={"ID":"3818b439-f299-4938-80cf-279895623b7d","Type":"ContainerDied","Data":"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"}
Sep 06 01:26:10.877529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.877218    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68" event={"ID":"3818b439-f299-4938-80cf-279895623b7d","Type":"ContainerDied","Data":"649f3b29278fe3869415ea5973fbae638c126f8ca54abd0b1a0dbac671b5e4ad"}
Sep 06 01:26:10.877529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.877241    2557 scope.go:117] "RemoveContainer" containerID="d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"
Sep 06 01:26:10.887056 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.887037    2557 scope.go:117] "RemoveContainer" containerID="d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"
Sep 06 01:26:10.887317 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:26:10.887299    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f\": container with ID starting with d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f not found: ID does not exist" containerID="d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"
Sep 06 01:26:10.887368 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.887325    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f"} err="failed to get container status \"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f\": rpc error: code = NotFound desc = could not find container \"d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f\": container with ID starting with d4d74a52c3ca0b0ed97cca855d6df11cb94f8a315cd30d87aec2f452e2365c1f not found: ID does not exist"
Sep 06 01:26:10.898886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.898861    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:26:10.904653 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:10.904629    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-062abb-openshift-default-5c86445f74-xtq68"]
Sep 06 01:26:12.163729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:12.163692    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3818b439-f299-4938-80cf-279895623b7d" path="/var/lib/kubelet/pods/3818b439-f299-4938-80cf-279895623b7d/volumes"
Sep 06 01:26:15.883587 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:15.883552    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:26:22.373859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.373332    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": read tcp 10.132.0.2:52396->10.132.0.77:15021: read: connection reset by peer" start-of-body=
Sep 06 01:26:22.373859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.373408    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": read tcp 10.132.0.2:52396->10.132.0.77:15021: read: connection reset by peer"
Sep 06 01:26:22.951086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.951049    2557 generic.go:356] "Generic (PLEG): container finished" podID="1aedda1c-de6e-4f3e-86da-675900857982" containerID="8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1" exitCode=0
Sep 06 01:26:22.951280 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.951127    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerDied","Data":"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"}
Sep 06 01:26:22.951551 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.951535    2557 scope.go:117] "RemoveContainer" containerID="8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"
Sep 06 01:26:22.952633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.952607    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:22.952686 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.952670    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:22.952722 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:22.952702    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:23.964519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:23.964472    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerStarted","Data":"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"}
Sep 06 01:26:23.998262 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:23.998217    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:24.998691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:24.998657    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:26:24.999064 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:24.998714    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 06 01:26:25.997912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:25.997875    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:26:25.998135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:25.997931    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 06 01:26:26.998663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:26.998630    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:26:26.999050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:26.998694    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 06 01:26:27.998859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:27.998822    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:26:27.999302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:27.998877    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 06 01:26:28.998743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:28.998705    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 06 01:26:28.998929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:28.998761    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 06 01:26:30.001784 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:30.001748    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:30.002246 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:30.002125    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:30.002742 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:30.002726    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:26:32.489427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.489392    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:26:32.489837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.489813    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy"
Sep 06 01:26:32.489837 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.489833    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy"
Sep 06 01:26:32.490031 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.489976    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3818b439-f299-4938-80cf-279895623b7d" containerName="istio-proxy"
Sep 06 01:26:32.493567 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.493549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.496030 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.496007    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-bff89d-openshift-default-dockercfg-8db8s\""
Sep 06 01:26:32.508839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.508798    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:26:32.655836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655865    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655916    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655952    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.655995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656233 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.656068    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxmr\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656233 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.656085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.656233 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.656148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756617    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756721    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756775    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxmr\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.756965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.756841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.757311 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.757176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.757362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.757329    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.757410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.757365    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.757537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.757519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.757645 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.757624    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.758891 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.758868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.759314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.759292    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.764406 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.764385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.764820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.764796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxmr\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr\") pod \"e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") " pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:32.805458 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:32.805409    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:33.087079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:33.087050    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:26:33.088715 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:26:33.088690    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bc259d7_f437_4a35_af5e_4a1fdfdc81b4.slice/crio-ad6112482fb4188f6773d58928d888df6c27d503841fb90b5b85abff8e19a71e WatchSource:0}: Error finding container ad6112482fb4188f6773d58928d888df6c27d503841fb90b5b85abff8e19a71e: Status 404 returned error can't find the container with id ad6112482fb4188f6773d58928d888df6c27d503841fb90b5b85abff8e19a71e
Sep 06 01:26:33.091036 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:33.091000    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:33.091123 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:33.091070    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:33.091123 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:33.091097    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:34.022600 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:34.022565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerStarted","Data":"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"}
Sep 06 01:26:34.023065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:34.022621    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerStarted","Data":"ad6112482fb4188f6773d58928d888df6c27d503841fb90b5b85abff8e19a71e"}
Sep 06 01:26:34.044956 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:34.044904    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podStartSLOduration=2.044888301 podStartE2EDuration="2.044888301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:34.043454515 +0000 UTC m=+1062.368874495" watchObservedRunningTime="2026-09-06 01:26:34.044888301 +0000 UTC m=+1062.370308347"
Sep 06 01:26:34.806488 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:34.806449    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:34.811315 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:34.811291    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:35.028573 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:35.028541    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:35.029621 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:35.029601    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:37.059586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.059546    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:26:37.064814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.064788    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.067301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.067273    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-bff89d-serving-cert\""
Sep 06 01:26:37.070651 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.070625    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:26:37.199810 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.199771    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvnxs\" (UniqueName: \"kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.200027 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.199861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.200027 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.199890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.301024 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.300988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvnxs\" (UniqueName: \"kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.301258 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.301046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.301258 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.301068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.301696 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.301670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.303667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.303645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.311953 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.311896    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvnxs\" (UniqueName: \"kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs\") pod \"maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.379886 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.379858    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:37.654968 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:37.654940    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:26:37.656949 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:26:37.656919    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d129b83_0d9a_4e97_b0f0_70e6e622dc56.slice/crio-303fa714a5a08bcbb55fc62595ecaeb0c6c9a84c5e9323172e2537270afa60fa WatchSource:0}: Error finding container 303fa714a5a08bcbb55fc62595ecaeb0c6c9a84c5e9323172e2537270afa60fa: Status 404 returned error can't find the container with id 303fa714a5a08bcbb55fc62595ecaeb0c6c9a84c5e9323172e2537270afa60fa
Sep 06 01:26:38.053329 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:38.053278    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" event={"ID":"6d129b83-0d9a-4e97-b0f0-70e6e622dc56","Type":"ContainerStarted","Data":"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"}
Sep 06 01:26:38.053506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:38.053349    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" event={"ID":"6d129b83-0d9a-4e97-b0f0-70e6e622dc56","Type":"ContainerStarted","Data":"303fa714a5a08bcbb55fc62595ecaeb0c6c9a84c5e9323172e2537270afa60fa"}
Sep 06 01:26:38.053506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:38.053492    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:38.072642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:38.072590    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" podStartSLOduration=0.756730309 podStartE2EDuration="1.072573182s" totalImagesPullingTime="315.842873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:26:38.070980147 +0000 UTC m=+1066.396400125" watchObservedRunningTime="2026-09-06 01:26:38.072573182 +0000 UTC m=+1066.397993159"
Sep 06 01:26:44.064501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:44.064473    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:26:52.317362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:52.317328    2557 scope.go:117] "RemoveContainer" containerID="3cf630be68c56497c146099ae906fe3b1288bd9c0fa5759d0ad254d53a5705b0"
Sep 06 01:26:52.327357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:52.327332    2557 scope.go:117] "RemoveContainer" containerID="2675567c20996a5a3c74e4a652c65b92bd3c07a0d20473436e8264f44126693f"
Sep 06 01:26:54.150147 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.150092    2557 generic.go:356] "Generic (PLEG): container finished" podID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerID="0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc" exitCode=0
Sep 06 01:26:54.150694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.150163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerDied","Data":"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"}
Sep 06 01:26:54.150694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.150658    2557 scope.go:117] "RemoveContainer" containerID="0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"
Sep 06 01:26:54.151949 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.151917    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:54.152014 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.151994    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:54.152073 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:54.152025    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:26:55.162388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:55.162350    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerStarted","Data":"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"}
Sep 06 01:26:55.805913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:55.805869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:26:55.806124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:55.806081    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:26:55.806190 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:55.806148    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 06 01:26:56.806798 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:56.806758    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:26:56.807358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:56.806838    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 06 01:26:57.805809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:57.805773    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:26:57.805994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:57.805826    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 06 01:26:58.806226 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:58.806174    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:26:58.806723 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:58.806274    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 06 01:26:59.806149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:59.806097    2557 patch_prober.go:28] interesting pod/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 06 01:26:59.806331 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:26:59.806180    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 06 01:27:00.810443 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:00.810405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:27:00.810904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:00.810698    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:27:00.811492 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:00.811475    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:27:01.813676 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:01.813640    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:01.817515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:01.817496    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:01.820431 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:01.820406    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hggws\""
Sep 06 01:27:01.822298 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:01.822275    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:01.942922 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:01.942890    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbjbp\" (UniqueName: \"kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp\") pod \"test-curl-7755-139823155832128\" (UID: \"76813e79-2f56-42b6-ad20-7fce2a3d6665\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:02.044147 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:02.044091    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbjbp\" (UniqueName: \"kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp\") pod \"test-curl-7755-139823155832128\" (UID: \"76813e79-2f56-42b6-ad20-7fce2a3d6665\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:02.052643 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:02.052610    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbjbp\" (UniqueName: \"kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp\") pod \"test-curl-7755-139823155832128\" (UID: \"76813e79-2f56-42b6-ad20-7fce2a3d6665\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:02.129986 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:02.129906    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:02.402017 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:02.401990    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:02.403761 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:02.403733    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76813e79_2f56_42b6_ad20_7fce2a3d6665.slice/crio-ab0ba5da719d448086fc757673b256dcc36d74e4c0b615aef83396a6c10e8c3e WatchSource:0}: Error finding container ab0ba5da719d448086fc757673b256dcc36d74e4c0b615aef83396a6c10e8c3e: Status 404 returned error can't find the container with id ab0ba5da719d448086fc757673b256dcc36d74e4c0b615aef83396a6c10e8c3e
Sep 06 01:27:03.211900 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:03.211874    2557 generic.go:356] "Generic (PLEG): container finished" podID="76813e79-2f56-42b6-ad20-7fce2a3d6665" containerID="eb1616695a19b3bed31186d6163b9526722bfdb03b23afdcdf7f8ec520d12fb9" exitCode=0
Sep 06 01:27:03.212213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:03.211954    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832128" event={"ID":"76813e79-2f56-42b6-ad20-7fce2a3d6665","Type":"ContainerDied","Data":"eb1616695a19b3bed31186d6163b9526722bfdb03b23afdcdf7f8ec520d12fb9"}
Sep 06 01:27:03.212213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:03.211996    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832128" event={"ID":"76813e79-2f56-42b6-ad20-7fce2a3d6665","Type":"ContainerStarted","Data":"ab0ba5da719d448086fc757673b256dcc36d74e4c0b615aef83396a6c10e8c3e"}
Sep 06 01:27:04.359987 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.359957    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:04.396853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.396826    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7755-139823155832128_76813e79-2f56-42b6-ad20-7fce2a3d6665/test-curl-7755-139823155832128/0.log"
Sep 06 01:27:04.419419 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.419386    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:04.424135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.424096    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:04.465267 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.465244    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbjbp\" (UniqueName: \"kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp\") pod \"76813e79-2f56-42b6-ad20-7fce2a3d6665\" (UID: \"76813e79-2f56-42b6-ad20-7fce2a3d6665\") "
Sep 06 01:27:04.467242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.467214    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp" (OuterVolumeSpecName: "kube-api-access-wbjbp") pod "76813e79-2f56-42b6-ad20-7fce2a3d6665" (UID: "76813e79-2f56-42b6-ad20-7fce2a3d6665"). InnerVolumeSpecName "kube-api-access-wbjbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:27:04.567007 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.566972    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbjbp\" (UniqueName: \"kubernetes.io/projected/76813e79-2f56-42b6-ad20-7fce2a3d6665-kube-api-access-wbjbp\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:27:04.569394 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.569370    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:04.569775 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.569762    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76813e79-2f56-42b6-ad20-7fce2a3d6665" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:04.569814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.569778    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="76813e79-2f56-42b6-ad20-7fce2a3d6665" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:04.569857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.569848    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="76813e79-2f56-42b6-ad20-7fce2a3d6665" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:04.572853 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.572835    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:04.577799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.577777    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:04.667709 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.667677    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crqnl\" (UniqueName: \"kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl\") pod \"test-curl-7755-139823155832128\" (UID: \"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:04.768537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.768449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqnl\" (UniqueName: \"kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl\") pod \"test-curl-7755-139823155832128\" (UID: \"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:04.777504 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.777475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crqnl\" (UniqueName: \"kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl\") pod \"test-curl-7755-139823155832128\" (UID: \"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8\") " pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:04.884273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:04.884239    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:05.152905 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:05.152879    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:05.155161 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:05.155140    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47f86a34_a9d2_4863_9a50_0e54e3d8e5b8.slice/crio-22569a94034b884a4dbacee083bb6b0435ebfcae6943f2d6e955329a5fa37ab1 WatchSource:0}: Error finding container 22569a94034b884a4dbacee083bb6b0435ebfcae6943f2d6e955329a5fa37ab1: Status 404 returned error can't find the container with id 22569a94034b884a4dbacee083bb6b0435ebfcae6943f2d6e955329a5fa37ab1
Sep 06 01:27:05.223819 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:05.223796    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:05.223957 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:05.223836    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab0ba5da719d448086fc757673b256dcc36d74e4c0b615aef83396a6c10e8c3e"
Sep 06 01:27:05.225067 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:05.225030    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832128" event={"ID":"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8","Type":"ContainerStarted","Data":"22569a94034b884a4dbacee083bb6b0435ebfcae6943f2d6e955329a5fa37ab1"}
Sep 06 01:27:05.236583 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:05.236555    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7755-139823155832128" oldPodUID="76813e79-2f56-42b6-ad20-7fce2a3d6665" podUID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8"
Sep 06 01:27:06.165461 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:06.165418    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76813e79-2f56-42b6-ad20-7fce2a3d6665" path="/var/lib/kubelet/pods/76813e79-2f56-42b6-ad20-7fce2a3d6665/volumes"
Sep 06 01:27:06.231417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:06.231380    2557 generic.go:356] "Generic (PLEG): container finished" podID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" containerID="abcec1648926e6c816178758047ed92504c4cfae4f1ff8cee4bbdd2a1f203744" exitCode=0
Sep 06 01:27:06.231617 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:06.231467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832128" event={"ID":"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8","Type":"ContainerDied","Data":"abcec1648926e6c816178758047ed92504c4cfae4f1ff8cee4bbdd2a1f203744"}
Sep 06 01:27:07.372934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.372907    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:07.395097 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.395074    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7755-139823155832128_47f86a34-a9d2-4863-9a50-0e54e3d8e5b8/test-curl-7755-139823155832128/0.log"
Sep 06 01:27:07.416332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.416299    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:07.418134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.418114    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7755-139823155832128"]
Sep 06 01:27:07.495348 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.495283    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crqnl\" (UniqueName: \"kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl\") pod \"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8\" (UID: \"47f86a34-a9d2-4863-9a50-0e54e3d8e5b8\") "
Sep 06 01:27:07.497292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.497263    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl" (OuterVolumeSpecName: "kube-api-access-crqnl") pod "47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" (UID: "47f86a34-a9d2-4863-9a50-0e54e3d8e5b8"). InnerVolumeSpecName "kube-api-access-crqnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:27:07.551952 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.551922    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:07.552402 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.552384    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:07.552494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.552403    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:07.552548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.552524    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" containerName="test-curl-7755-139823155832128"
Sep 06 01:27:07.555688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.555670    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:07.562641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.562616    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:07.595934 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.595905    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgjk\" (UniqueName: \"kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk\") pod \"test-curl-7755-139823155832704\" (UID: \"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:07.596064 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.596052    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crqnl\" (UniqueName: \"kubernetes.io/projected/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8-kube-api-access-crqnl\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:27:07.697301 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.697270    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgjk\" (UniqueName: \"kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk\") pod \"test-curl-7755-139823155832704\" (UID: \"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:07.705511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.705490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgjk\" (UniqueName: \"kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk\") pod \"test-curl-7755-139823155832704\" (UID: \"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:07.866090 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:07.866009    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:08.137875 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:08.137847    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:08.139307 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:08.139281    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40b8bb12_afdf_4ae9_ab7a_f58b5a11f5af.slice/crio-a7362445d5f43776ae9d5a36de9c2b59cca19c65c087247069302db2cfbba449 WatchSource:0}: Error finding container a7362445d5f43776ae9d5a36de9c2b59cca19c65c087247069302db2cfbba449: Status 404 returned error can't find the container with id a7362445d5f43776ae9d5a36de9c2b59cca19c65c087247069302db2cfbba449
Sep 06 01:27:08.164553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:08.164525    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47f86a34-a9d2-4863-9a50-0e54e3d8e5b8" path="/var/lib/kubelet/pods/47f86a34-a9d2-4863-9a50-0e54e3d8e5b8/volumes"
Sep 06 01:27:08.244693 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:08.244661    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832704" event={"ID":"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af","Type":"ContainerStarted","Data":"a7362445d5f43776ae9d5a36de9c2b59cca19c65c087247069302db2cfbba449"}
Sep 06 01:27:08.246016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:08.245993    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832128"
Sep 06 01:27:08.246131 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:08.246036    2557 scope.go:117] "RemoveContainer" containerID="abcec1648926e6c816178758047ed92504c4cfae4f1ff8cee4bbdd2a1f203744"
Sep 06 01:27:09.253688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:09.253651    2557 generic.go:356] "Generic (PLEG): container finished" podID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" containerID="23fb8d939c9a5ede5e4abb117240da5c4290e6e01ad0c7a1886c6ccba0673cce" exitCode=0
Sep 06 01:27:09.254214 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:09.253708    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832704" event={"ID":"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af","Type":"ContainerDied","Data":"23fb8d939c9a5ede5e4abb117240da5c4290e6e01ad0c7a1886c6ccba0673cce"}
Sep 06 01:27:10.396383 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.396359    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:10.416414 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.416388    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7755-139823155832704_40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af/test-curl-7755-139823155832704/0.log"
Sep 06 01:27:10.440640 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.440604    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:10.443891 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.443869    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:10.522622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.522548    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjgjk\" (UniqueName: \"kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk\") pod \"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af\" (UID: \"40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af\") "
Sep 06 01:27:10.524574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.524549    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk" (OuterVolumeSpecName: "kube-api-access-jjgjk") pod "40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" (UID: "40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af"). InnerVolumeSpecName "kube-api-access-jjgjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:27:10.570316 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.570290    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:10.570715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.570701    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:10.570767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.570717    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:10.570806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.570785    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:10.573876 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.573860    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:10.578702 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.578674    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:10.623967 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.623942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n9d4\" (UniqueName: \"kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4\") pod \"test-curl-7755-139823155832704\" (UID: \"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:10.624088 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.624054    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjgjk\" (UniqueName: \"kubernetes.io/projected/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af-kube-api-access-jjgjk\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:27:10.724780 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.724750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n9d4\" (UniqueName: \"kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4\") pod \"test-curl-7755-139823155832704\" (UID: \"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:10.732479 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.732450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n9d4\" (UniqueName: \"kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4\") pod \"test-curl-7755-139823155832704\" (UID: \"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add\") " pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:10.885141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:10.885038    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:11.161379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:11.161356    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:11.163801 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:11.163774    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3afe5e3b_e3ad_45d6_85e6_ea465eaa9add.slice/crio-b3640bde589a475713bcf931ee02fec2b5de7da394b78b5ac5e68554fb6185b9 WatchSource:0}: Error finding container b3640bde589a475713bcf931ee02fec2b5de7da394b78b5ac5e68554fb6185b9: Status 404 returned error can't find the container with id b3640bde589a475713bcf931ee02fec2b5de7da394b78b5ac5e68554fb6185b9
Sep 06 01:27:11.268548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:11.268520    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:11.268548 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:11.268547    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7362445d5f43776ae9d5a36de9c2b59cca19c65c087247069302db2cfbba449"
Sep 06 01:27:11.269869 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:11.269835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832704" event={"ID":"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add","Type":"ContainerStarted","Data":"b3640bde589a475713bcf931ee02fec2b5de7da394b78b5ac5e68554fb6185b9"}
Sep 06 01:27:11.279994 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:11.279970    2557 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7755-139823155832704" oldPodUID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" podUID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add"
Sep 06 01:27:12.166755 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:12.166668    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af" path="/var/lib/kubelet/pods/40b8bb12-afdf-4ae9-ab7a-f58b5a11f5af/volumes"
Sep 06 01:27:12.276898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:12.276863    2557 generic.go:356] "Generic (PLEG): container finished" podID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" containerID="4aed8856ac34fb84a087d247f9b49e036278e5aa7dc38aca76182fb94ac4a4f9" exitCode=0
Sep 06 01:27:12.277091 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:12.276906    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7755-139823155832704" event={"ID":"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add","Type":"ContainerDied","Data":"4aed8856ac34fb84a087d247f9b49e036278e5aa7dc38aca76182fb94ac4a4f9"}
Sep 06 01:27:13.419662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.419637    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:13.437782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.437757    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7755-139823155832704_3afe5e3b-e3ad-45d6-85e6-ea465eaa9add/test-curl-7755-139823155832704/0.log"
Sep 06 01:27:13.457484 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.457458    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:13.463679 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.463651    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7755-139823155832704"]
Sep 06 01:27:13.549773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.549700    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5n9d4\" (UniqueName: \"kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4\") pod \"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add\" (UID: \"3afe5e3b-e3ad-45d6-85e6-ea465eaa9add\") "
Sep 06 01:27:13.551775 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.551752    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4" (OuterVolumeSpecName: "kube-api-access-5n9d4") pod "3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" (UID: "3afe5e3b-e3ad-45d6-85e6-ea465eaa9add"). InnerVolumeSpecName "kube-api-access-5n9d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:27:13.650801 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:13.650771    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5n9d4\" (UniqueName: \"kubernetes.io/projected/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add-kube-api-access-5n9d4\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:27:14.163999 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.163971    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" path="/var/lib/kubelet/pods/3afe5e3b-e3ad-45d6-85e6-ea465eaa9add/volumes"
Sep 06 01:27:14.295907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.295861    2557 scope.go:117] "RemoveContainer" containerID="4aed8856ac34fb84a087d247f9b49e036278e5aa7dc38aca76182fb94ac4a4f9"
Sep 06 01:27:14.296066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.295880    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7755-139823155832704"
Sep 06 01:27:14.341068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.341036    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:27:14.341753 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.341727    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:14.341873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.341756    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:14.341943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.341885    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afe5e3b-e3ad-45d6-85e6-ea465eaa9add" containerName="test-curl-7755-139823155832704"
Sep 06 01:27:14.347025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.346988    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.349665 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.349644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2c9b203a-openshift-default-dockercfg-sfscw\""
Sep 06 01:27:14.358901 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.358868    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:27:14.459941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.459903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.459941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.459944    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460087    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mws8t\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460155    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.460372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.460252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561324    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561367 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561366    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561549    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561625 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561675    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mws8t\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561756    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.561904 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.561841    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.562063 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.562027    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.562174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.562151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.562397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.562366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.562474 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.562411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.563830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.563808    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.564003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.563957    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.569462 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.569440    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mws8t\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.569544 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.569514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token\") pod \"e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") " pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.672757 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.672729    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:14.950216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.950186    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:27:14.952092 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:14.952059    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff17de9c_cf56_4cc0_8496_78a6a7f32609.slice/crio-dd6f47948031685fb7119c8ccfcaab20306c12e3d7eb8b44f90d69fc5c1f7d3c WatchSource:0}: Error finding container dd6f47948031685fb7119c8ccfcaab20306c12e3d7eb8b44f90d69fc5c1f7d3c: Status 404 returned error can't find the container with id dd6f47948031685fb7119c8ccfcaab20306c12e3d7eb8b44f90d69fc5c1f7d3c
Sep 06 01:27:14.954690 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.954645    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:14.954770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.954742    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:14.954816 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:14.954787    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:15.302499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:15.302410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerStarted","Data":"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"}
Sep 06 01:27:15.302499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:15.302473    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerStarted","Data":"dd6f47948031685fb7119c8ccfcaab20306c12e3d7eb8b44f90d69fc5c1f7d3c"}
Sep 06 01:27:15.324084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:15.324038    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podStartSLOduration=1.324022815 podStartE2EDuration="1.324022815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:27:15.322382482 +0000 UTC m=+1103.647802461" watchObservedRunningTime="2026-09-06 01:27:15.324022815 +0000 UTC m=+1103.649442791"
Sep 06 01:27:15.672914 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:15.672839    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:16.678517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:16.678486    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:17.314089 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:17.314060    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:17.315172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:17.315147    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:18.601766 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.601735    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:27:18.605948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.605921    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.608422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.608398    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2c9b203a-serving-cert\""
Sep 06 01:27:18.616858 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.616829    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:27:18.703453 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.703423    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trwl8\" (UniqueName: \"kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.703581 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.703487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.703581 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.703552    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.804746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.804712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.804919 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.804845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trwl8\" (UniqueName: \"kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.804979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.804961    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.805603 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.805574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.807293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.807269    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.813094 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.813069    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trwl8\" (UniqueName: \"kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8\") pod \"maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:18.919530 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:18.919456    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:19.196054 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:19.196025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:27:19.198055 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:27:19.197979    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3190850e_33ed_4971_bd78_04663fd2abb3.slice/crio-38f2ed97f447706b36b5509fe8918cca61f8e18668a90121d24b131b4d1c01b4 WatchSource:0}: Error finding container 38f2ed97f447706b36b5509fe8918cca61f8e18668a90121d24b131b4d1c01b4: Status 404 returned error can't find the container with id 38f2ed97f447706b36b5509fe8918cca61f8e18668a90121d24b131b4d1c01b4
Sep 06 01:27:19.327599 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:19.327565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" event={"ID":"3190850e-33ed-4971-bd78-04663fd2abb3","Type":"ContainerStarted","Data":"38f2ed97f447706b36b5509fe8918cca61f8e18668a90121d24b131b4d1c01b4"}
Sep 06 01:27:20.335068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:20.335029    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" event={"ID":"3190850e-33ed-4971-bd78-04663fd2abb3","Type":"ContainerStarted","Data":"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"}
Sep 06 01:27:20.335458 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:20.335167    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:20.353135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:20.353072    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" podStartSLOduration=1.916604285 podStartE2EDuration="2.353056953s" totalImagesPullingTime="436.452668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:27:20.350914477 +0000 UTC m=+1108.676334455" watchObservedRunningTime="2026-09-06 01:27:20.353056953 +0000 UTC m=+1108.678476953"
Sep 06 01:27:26.347239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:26.347207    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:27:39.453635 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.453601    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerID="897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c" exitCode=0
Sep 06 01:27:39.454067 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.453645    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerDied","Data":"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"}
Sep 06 01:27:39.454067 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.453984    2557 scope.go:117] "RemoveContainer" containerID="897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"
Sep 06 01:27:39.455186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.455155    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:39.455292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.455241    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:39.455359 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:39.455291    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:27:40.478826 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:40.478787    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerStarted","Data":"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"}
Sep 06 01:27:40.673480 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:40.673438    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:40.673740 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:40.673709    2557 patch_prober.go:28] interesting pod/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 06 01:27:40.673802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:40.673780    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 06 01:27:41.673863 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:41.673826    2557 patch_prober.go:28] interesting pod/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 06 01:27:41.674278 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:41.673900    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 06 01:27:42.673360 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:42.673318    2557 patch_prober.go:28] interesting pod/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 06 01:27:42.673540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:42.673394    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 06 01:27:43.673455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:43.673414    2557 patch_prober.go:28] interesting pod/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 06 01:27:43.673944 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:43.673479    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 06 01:27:44.673799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:44.673750    2557 patch_prober.go:28] interesting pod/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Sep 06 01:27:44.674206 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:44.673813    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Sep 06 01:27:45.791358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:45.791324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:45.791799 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:45.791632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:45.792384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:45.792365    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:27:52.363412 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:27:52.363379    2557 scope.go:117] "RemoveContainer" containerID="52338302bdaabd826c8930993a17d27235ecd24fa638fec2492745ee1771b31d"
Sep 06 01:28:37.601478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.601446    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7758-8b37f1"]
Sep 06 01:28:37.605247 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.605227    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:37.607478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.607453    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hggws\""
Sep 06 01:28:37.613511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.613488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-8b37f1"]
Sep 06 01:28:37.691867 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.691825    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvt7p\" (UniqueName: \"kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p\") pod \"mt-curl-7758-8b37f1\" (UID: \"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5\") " pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:37.793433 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.793396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvt7p\" (UniqueName: \"kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p\") pod \"mt-curl-7758-8b37f1\" (UID: \"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5\") " pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:37.801306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.801277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvt7p\" (UniqueName: \"kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p\") pod \"mt-curl-7758-8b37f1\" (UID: \"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5\") " pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:37.915870 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:37.915786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:38.188266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:38.188242    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-8b37f1"]
Sep 06 01:28:38.190040 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:28:38.190012    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ba1e7ac_431d_41f5_9a8f_9cbd7f5252f5.slice/crio-09fe613475529f9aa9be45a5a109a367c172f1f01ce33948ec7366e6e91c4740 WatchSource:0}: Error finding container 09fe613475529f9aa9be45a5a109a367c172f1f01ce33948ec7366e6e91c4740: Status 404 returned error can't find the container with id 09fe613475529f9aa9be45a5a109a367c172f1f01ce33948ec7366e6e91c4740
Sep 06 01:28:38.814667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:38.814633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-8b37f1" event={"ID":"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5","Type":"ContainerStarted","Data":"09fe613475529f9aa9be45a5a109a367c172f1f01ce33948ec7366e6e91c4740"}
Sep 06 01:28:39.821551 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:39.821512    2557 generic.go:356] "Generic (PLEG): container finished" podID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" containerID="5c788243acfbf909f475423b88dcb4a541130c31a6ed962bcea75b22b21f9685" exitCode=0
Sep 06 01:28:39.821941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:39.821567    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-8b37f1" event={"ID":"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5","Type":"ContainerDied","Data":"5c788243acfbf909f475423b88dcb4a541130c31a6ed962bcea75b22b21f9685"}
Sep 06 01:28:40.966691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:40.966668    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:40.985526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:40.985500    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7758-8b37f1_7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5/mt-curl-7758-8b37f1/0.log"
Sep 06 01:28:41.005188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.005164    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7758-8b37f1"]
Sep 06 01:28:41.011127 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.011094    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7758-8b37f1"]
Sep 06 01:28:41.125873 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.125782    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvt7p\" (UniqueName: \"kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p\") pod \"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5\" (UID: \"7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5\") "
Sep 06 01:28:41.127910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.127884    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p" (OuterVolumeSpecName: "kube-api-access-pvt7p") pod "7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" (UID: "7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5"). InnerVolumeSpecName "kube-api-access-pvt7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:41.226947 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.226914    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvt7p\" (UniqueName: \"kubernetes.io/projected/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5-kube-api-access-pvt7p\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:28:41.834827 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.834795    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:41.834992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:41.834836    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09fe613475529f9aa9be45a5a109a367c172f1f01ce33948ec7366e6e91c4740"
Sep 06 01:28:41.844717 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:28:41.844686    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7758-8b37f1\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:42.162038 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:28:42.161952    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7758-8b37f1\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" pod="opendatahub/mt-curl-7758-8b37f1"
Sep 06 01:28:42.164191 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:42.164167    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" path="/var/lib/kubelet/pods/7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5/volumes"
Sep 06 01:28:43.198992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.198956    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:28:43.199525 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.199211    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" podUID="3190850e-33ed-4971-bd78-04663fd2abb3" containerName="maas-api" containerID="cri-o://48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e" gracePeriod=30
Sep 06 01:28:43.467092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.467020    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:28:43.654866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.654836    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trwl8\" (UniqueName: \"kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8\") pod \"3190850e-33ed-4971-bd78-04663fd2abb3\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") "
Sep 06 01:28:43.655048 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.654880    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca\") pod \"3190850e-33ed-4971-bd78-04663fd2abb3\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") "
Sep 06 01:28:43.655048 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.654990    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls\") pod \"3190850e-33ed-4971-bd78-04663fd2abb3\" (UID: \"3190850e-33ed-4971-bd78-04663fd2abb3\") "
Sep 06 01:28:43.655373 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.655344    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3190850e-33ed-4971-bd78-04663fd2abb3" (UID: "3190850e-33ed-4971-bd78-04663fd2abb3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:28:43.656992 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.656959    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8" (OuterVolumeSpecName: "kube-api-access-trwl8") pod "3190850e-33ed-4971-bd78-04663fd2abb3" (UID: "3190850e-33ed-4971-bd78-04663fd2abb3"). InnerVolumeSpecName "kube-api-access-trwl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:28:43.657162 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.657132    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3190850e-33ed-4971-bd78-04663fd2abb3" (UID: "3190850e-33ed-4971-bd78-04663fd2abb3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:28:43.756663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.756591    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3190850e-33ed-4971-bd78-04663fd2abb3-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.756663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.756619    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trwl8\" (UniqueName: \"kubernetes.io/projected/3190850e-33ed-4971-bd78-04663fd2abb3-kube-api-access-trwl8\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.756663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.756631    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3190850e-33ed-4971-bd78-04663fd2abb3-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:28:43.854892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.854854    2557 generic.go:356] "Generic (PLEG): container finished" podID="3190850e-33ed-4971-bd78-04663fd2abb3" containerID="48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e" exitCode=0
Sep 06 01:28:43.855055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.854907    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"
Sep 06 01:28:43.855055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.854934    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" event={"ID":"3190850e-33ed-4971-bd78-04663fd2abb3","Type":"ContainerDied","Data":"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"}
Sep 06 01:28:43.855055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.855007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9" event={"ID":"3190850e-33ed-4971-bd78-04663fd2abb3","Type":"ContainerDied","Data":"38f2ed97f447706b36b5509fe8918cca61f8e18668a90121d24b131b4d1c01b4"}
Sep 06 01:28:43.855055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.855031    2557 scope.go:117] "RemoveContainer" containerID="48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"
Sep 06 01:28:43.865661 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.865643    2557 scope.go:117] "RemoveContainer" containerID="48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"
Sep 06 01:28:43.865942 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:28:43.865924    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e\": container with ID starting with 48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e not found: ID does not exist" containerID="48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"
Sep 06 01:28:43.865996 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.865950    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e"} err="failed to get container status \"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e\": rpc error: code = NotFound desc = could not find container \"48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e\": container with ID starting with 48cc043c50121334b41b514102b7f9e8fadeb20841faae90acb7d4b7f21bbe6e not found: ID does not exist"
Sep 06 01:28:43.877432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.877411    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:28:43.879368 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:43.879348    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2c9b203a-6c9f8647c7-ldtr9"]
Sep 06 01:28:44.163793 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:44.163713    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3190850e-33ed-4971-bd78-04663fd2abb3" path="/var/lib/kubelet/pods/3190850e-33ed-4971-bd78-04663fd2abb3/volumes"
Sep 06 01:28:52.199372 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:52.199343    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:28:52.205710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:52.205681    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:28:52.396989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:52.396955    2557 scope.go:117] "RemoveContainer" containerID="2ae613ef20e83648314d8fd145310b61e6d6c19a2d888f464502616585a694dd"
Sep 06 01:28:52.405953 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:28:52.405930    2557 scope.go:117] "RemoveContainer" containerID="ba0e08697ae8982843999c7053a2eef50955f2ec32a588ac32c94eec22625497"
Sep 06 01:29:34.664859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:34.664822    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:29:34.665364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:34.665062    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy" containerID="cri-o://4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931" gracePeriod=30
Sep 06 01:29:39.915068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:39.915044    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:29:40.007165 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007132    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007170    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007250    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007282    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007371    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007414    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007440    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mws8t\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007472    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket\") pod \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\" (UID: \"ff17de9c-cf56-4cc0-8496-78a6a7f32609\") "
Sep 06 01:29:40.007569 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007506    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:40.007805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007577    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:40.007805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007601    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:40.007805 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007731    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:40.007960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007878    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:29:40.007960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007885    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.007960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007932    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.007960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007949    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.008136 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.007961    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.009363 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.009338    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:29:40.009499 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.009455    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:29:40.009573 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.009509    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t" (OuterVolumeSpecName: "kube-api-access-mws8t") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "kube-api-access-mws8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:29:40.009781 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.009760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff17de9c-cf56-4cc0-8496-78a6a7f32609" (UID: "ff17de9c-cf56-4cc0-8496-78a6a7f32609"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:29:40.108786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.108762    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.108786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.108784    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.108936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.108793    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.108936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.108801    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff17de9c-cf56-4cc0-8496-78a6a7f32609-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.108936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.108810    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mws8t\" (UniqueName: \"kubernetes.io/projected/ff17de9c-cf56-4cc0-8496-78a6a7f32609-kube-api-access-mws8t\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:40.173021 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.172991    2557 generic.go:356] "Generic (PLEG): container finished" podID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerID="4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931" exitCode=0
Sep 06 01:29:40.173160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.173028    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerDied","Data":"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"}
Sep 06 01:29:40.173160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.173068    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"
Sep 06 01:29:40.173160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.173090    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42" event={"ID":"ff17de9c-cf56-4cc0-8496-78a6a7f32609","Type":"ContainerDied","Data":"dd6f47948031685fb7119c8ccfcaab20306c12e3d7eb8b44f90d69fc5c1f7d3c"}
Sep 06 01:29:40.173160 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.173125    2557 scope.go:117] "RemoveContainer" containerID="4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"
Sep 06 01:29:40.182048 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.182033    2557 scope.go:117] "RemoveContainer" containerID="897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"
Sep 06 01:29:40.190320 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.190296    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:29:40.190515 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.190493    2557 scope.go:117] "RemoveContainer" containerID="4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"
Sep 06 01:29:40.190781 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:29:40.190762    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931\": container with ID starting with 4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931 not found: ID does not exist" containerID="4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"
Sep 06 01:29:40.190833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.190790    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931"} err="failed to get container status \"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931\": rpc error: code = NotFound desc = could not find container \"4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931\": container with ID starting with 4af1d2ece0f43c78f56682b1a913dbb2d859cfc192ca3e438e7b8c3314e5b931 not found: ID does not exist"
Sep 06 01:29:40.190833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.190805    2557 scope.go:117] "RemoveContainer" containerID="897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"
Sep 06 01:29:40.191063 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:29:40.191045    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c\": container with ID starting with 897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c not found: ID does not exist" containerID="897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"
Sep 06 01:29:40.191134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.191065    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c"} err="failed to get container status \"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c\": rpc error: code = NotFound desc = could not find container \"897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c\": container with ID starting with 897e050147fd0864de3fccdf59a9cae03d163b1eacb00398741c13b841bcfe4c not found: ID does not exist"
Sep 06 01:29:40.195531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:40.195509    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2c9b203a-openshift-default-5dbf9dd6b4-rrp42"]
Sep 06 01:29:42.164865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:42.164835    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" path="/var/lib/kubelet/pods/ff17de9c-cf56-4cc0-8496-78a6a7f32609/volumes"
Sep 06 01:29:52.437361 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:52.437283    2557 scope.go:117] "RemoveContainer" containerID="815e2a4d095a75832a0ddeb4817ae17ee077e3f90a75519d0a1425d8545a4bce"
Sep 06 01:29:54.242312 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242268    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7758-3d6e65"]
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242689    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" containerName="mt-curl-7758-8b37f1"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242702    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" containerName="mt-curl-7758-8b37f1"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242712    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3190850e-33ed-4971-bd78-04663fd2abb3" containerName="maas-api"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242718    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3190850e-33ed-4971-bd78-04663fd2abb3" containerName="maas-api"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242734    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242739    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242757    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.242802 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242762    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.243239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242814    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.243239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242821    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3190850e-33ed-4971-bd78-04663fd2abb3" containerName="maas-api"
Sep 06 01:29:54.243239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242829    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff17de9c-cf56-4cc0-8496-78a6a7f32609" containerName="istio-proxy"
Sep 06 01:29:54.243239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.242837    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba1e7ac-431d-41f5-9a8f-9cbd7f5252f5" containerName="mt-curl-7758-8b37f1"
Sep 06 01:29:54.247456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.247433    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:54.252230 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.252206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-3d6e65"]
Sep 06 01:29:54.265383 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.265361    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hggws\""
Sep 06 01:29:54.344178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.344136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rgd\" (UniqueName: \"kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd\") pod \"mt-curl-7758-3d6e65\" (UID: \"18e7e702-f218-487c-bfbd-e5b5f59229e5\") " pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:54.445005 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.444960    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rgd\" (UniqueName: \"kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd\") pod \"mt-curl-7758-3d6e65\" (UID: \"18e7e702-f218-487c-bfbd-e5b5f59229e5\") " pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:54.453125 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.453064    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rgd\" (UniqueName: \"kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd\") pod \"mt-curl-7758-3d6e65\" (UID: \"18e7e702-f218-487c-bfbd-e5b5f59229e5\") " pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:54.559983 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.559892    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:54.833172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:54.833046    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-3d6e65"]
Sep 06 01:29:54.836033 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:29:54.836008    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18e7e702_f218_487c_bfbd_e5b5f59229e5.slice/crio-68cc10b8e5cba2bf916f70382c251f240280534a08fb22ac34a94f3c4fc71d11 WatchSource:0}: Error finding container 68cc10b8e5cba2bf916f70382c251f240280534a08fb22ac34a94f3c4fc71d11: Status 404 returned error can't find the container with id 68cc10b8e5cba2bf916f70382c251f240280534a08fb22ac34a94f3c4fc71d11
Sep 06 01:29:55.260052 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:55.260021    2557 generic.go:356] "Generic (PLEG): container finished" podID="18e7e702-f218-487c-bfbd-e5b5f59229e5" containerID="d62d9a6b19c9aace1f15da036494f409b57f48f4f5e67f6cf22fad62d3731e18" exitCode=0
Sep 06 01:29:55.260429 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:55.260122    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-3d6e65" event={"ID":"18e7e702-f218-487c-bfbd-e5b5f59229e5","Type":"ContainerDied","Data":"d62d9a6b19c9aace1f15da036494f409b57f48f4f5e67f6cf22fad62d3731e18"}
Sep 06 01:29:55.260429 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:55.260164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-3d6e65" event={"ID":"18e7e702-f218-487c-bfbd-e5b5f59229e5","Type":"ContainerStarted","Data":"68cc10b8e5cba2bf916f70382c251f240280534a08fb22ac34a94f3c4fc71d11"}
Sep 06 01:29:56.395789 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.395761    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:56.414895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.414868    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7758-3d6e65_18e7e702-f218-487c-bfbd-e5b5f59229e5/mt-curl-7758-3d6e65/0.log"
Sep 06 01:29:56.435430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.435398    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7758-3d6e65"]
Sep 06 01:29:56.438998 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.438976    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7758-3d6e65"]
Sep 06 01:29:56.564507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.564413    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7rgd\" (UniqueName: \"kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd\") pod \"18e7e702-f218-487c-bfbd-e5b5f59229e5\" (UID: \"18e7e702-f218-487c-bfbd-e5b5f59229e5\") "
Sep 06 01:29:56.566603 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.566573    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd" (OuterVolumeSpecName: "kube-api-access-f7rgd") pod "18e7e702-f218-487c-bfbd-e5b5f59229e5" (UID: "18e7e702-f218-487c-bfbd-e5b5f59229e5"). InnerVolumeSpecName "kube-api-access-f7rgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:29:56.567531 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.567511    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7758-a9ccbf"]
Sep 06 01:29:56.567932 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.567920    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e7e702-f218-487c-bfbd-e5b5f59229e5" containerName="mt-curl-7758-3d6e65"
Sep 06 01:29:56.567978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.567934    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e7e702-f218-487c-bfbd-e5b5f59229e5" containerName="mt-curl-7758-3d6e65"
Sep 06 01:29:56.568011 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.567998    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e7e702-f218-487c-bfbd-e5b5f59229e5" containerName="mt-curl-7758-3d6e65"
Sep 06 01:29:56.570663 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.570648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:56.578364 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.578271    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-a9ccbf"]
Sep 06 01:29:56.666076 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.666041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvv9\" (UniqueName: \"kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9\") pod \"mt-curl-7758-a9ccbf\" (UID: \"7fa167e3-2eb6-4765-8db1-b5d7d4a66904\") " pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:56.666241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.666180    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7rgd\" (UniqueName: \"kubernetes.io/projected/18e7e702-f218-487c-bfbd-e5b5f59229e5-kube-api-access-f7rgd\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:29:56.766797 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.766753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvv9\" (UniqueName: \"kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9\") pod \"mt-curl-7758-a9ccbf\" (UID: \"7fa167e3-2eb6-4765-8db1-b5d7d4a66904\") " pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:56.776553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.776520    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvv9\" (UniqueName: \"kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9\") pod \"mt-curl-7758-a9ccbf\" (UID: \"7fa167e3-2eb6-4765-8db1-b5d7d4a66904\") " pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:56.883989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:56.883908    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:57.155050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:57.155026    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7758-a9ccbf"]
Sep 06 01:29:57.157294 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:29:57.157268    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fa167e3_2eb6_4765_8db1_b5d7d4a66904.slice/crio-ea7620a0ae959d1dced5400c760cf291dfb77a6703715d4b9b5cc1e6ce0e2cee WatchSource:0}: Error finding container ea7620a0ae959d1dced5400c760cf291dfb77a6703715d4b9b5cc1e6ce0e2cee: Status 404 returned error can't find the container with id ea7620a0ae959d1dced5400c760cf291dfb77a6703715d4b9b5cc1e6ce0e2cee
Sep 06 01:29:57.272269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:57.272241    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:57.272410 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:57.272247    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68cc10b8e5cba2bf916f70382c251f240280534a08fb22ac34a94f3c4fc71d11"
Sep 06 01:29:57.273641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:57.273614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-a9ccbf" event={"ID":"7fa167e3-2eb6-4765-8db1-b5d7d4a66904","Type":"ContainerStarted","Data":"ea7620a0ae959d1dced5400c760cf291dfb77a6703715d4b9b5cc1e6ce0e2cee"}
Sep 06 01:29:57.282625 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:29:57.282599    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7758-3d6e65\" is forbidden: User \"system:node:ip-10-0-132-189.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-132-189.ec2.internal' and this object" podUID="18e7e702-f218-487c-bfbd-e5b5f59229e5" pod="opendatahub/mt-curl-7758-3d6e65"
Sep 06 01:29:58.163883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:58.163853    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e7e702-f218-487c-bfbd-e5b5f59229e5" path="/var/lib/kubelet/pods/18e7e702-f218-487c-bfbd-e5b5f59229e5/volumes"
Sep 06 01:29:58.280408 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:58.280371    2557 generic.go:356] "Generic (PLEG): container finished" podID="7fa167e3-2eb6-4765-8db1-b5d7d4a66904" containerID="fc83fd3585e10eb7f3299d9f4dd011268ccc9721a4bbe1b9f45d35adb2d3f353" exitCode=0
Sep 06 01:29:58.280545 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:58.280459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7758-a9ccbf" event={"ID":"7fa167e3-2eb6-4765-8db1-b5d7d4a66904","Type":"ContainerDied","Data":"fc83fd3585e10eb7f3299d9f4dd011268ccc9721a4bbe1b9f45d35adb2d3f353"}
Sep 06 01:29:59.433239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.433209    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:29:59.453115 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.453085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7758-a9ccbf_7fa167e3-2eb6-4765-8db1-b5d7d4a66904/mt-curl-7758-a9ccbf/0.log"
Sep 06 01:29:59.474472 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.474434    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7758-a9ccbf"]
Sep 06 01:29:59.478206 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.478181    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7758-a9ccbf"]
Sep 06 01:29:59.595942 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.595857    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkvv9\" (UniqueName: \"kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9\") pod \"7fa167e3-2eb6-4765-8db1-b5d7d4a66904\" (UID: \"7fa167e3-2eb6-4765-8db1-b5d7d4a66904\") "
Sep 06 01:29:59.597869 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.597841    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9" (OuterVolumeSpecName: "kube-api-access-xkvv9") pod "7fa167e3-2eb6-4765-8db1-b5d7d4a66904" (UID: "7fa167e3-2eb6-4765-8db1-b5d7d4a66904"). InnerVolumeSpecName "kube-api-access-xkvv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:29:59.697435 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:29:59.697397    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkvv9\" (UniqueName: \"kubernetes.io/projected/7fa167e3-2eb6-4765-8db1-b5d7d4a66904-kube-api-access-xkvv9\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:30:00.165553 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:00.165523    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa167e3-2eb6-4765-8db1-b5d7d4a66904" path="/var/lib/kubelet/pods/7fa167e3-2eb6-4765-8db1-b5d7d4a66904/volumes"
Sep 06 01:30:00.293790 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:00.293759    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7758-a9ccbf"
Sep 06 01:30:00.293958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:00.293773    2557 scope.go:117] "RemoveContainer" containerID="fc83fd3585e10eb7f3299d9f4dd011268ccc9721a4bbe1b9f45d35adb2d3f353"
Sep 06 01:30:29.605189 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.605150    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:30:29.605786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.605765    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa167e3-2eb6-4765-8db1-b5d7d4a66904" containerName="mt-curl-7758-a9ccbf"
Sep 06 01:30:29.605786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.605787    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa167e3-2eb6-4765-8db1-b5d7d4a66904" containerName="mt-curl-7758-a9ccbf"
Sep 06 01:30:29.605928 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.605910    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa167e3-2eb6-4765-8db1-b5d7d4a66904" containerName="mt-curl-7758-a9ccbf"
Sep 06 01:30:29.609586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.609561    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.611358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.611334    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:30:29.612190 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.612167    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a7b006-openshift-default-dockercfg-fkd49\""
Sep 06 01:30:29.667352 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667322    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjnm\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667424    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667519    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667549    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667603    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.667735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.667675    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.768819 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.768783    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.768829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.768909    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769086    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjnm\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769164 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769381 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769181    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769381 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769208    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769381 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769244    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769381 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769294    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769599 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769597    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.769923 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.769902    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.771400 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.771381    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.771725 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.771702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.776884 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.776854    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.776988 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.776948    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjnm\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm\") pod \"e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") " pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:29.921509 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:29.921437    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:30.199812 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.199788    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:30:30.201736 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:30:30.201711    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63b5ad1_d935_40a9_974d_6c85cec632bb.slice/crio-04ac07e6f16856621325a1ceeee53229c656818750aa3f3a8be0b5ab6e694661 WatchSource:0}: Error finding container 04ac07e6f16856621325a1ceeee53229c656818750aa3f3a8be0b5ab6e694661: Status 404 returned error can't find the container with id 04ac07e6f16856621325a1ceeee53229c656818750aa3f3a8be0b5ab6e694661
Sep 06 01:30:30.203963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.203919    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:30.204049 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.204016    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:30.204093 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.204061    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:30.462432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.462340    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerStarted","Data":"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"}
Sep 06 01:30:30.462432 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.462410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerStarted","Data":"04ac07e6f16856621325a1ceeee53229c656818750aa3f3a8be0b5ab6e694661"}
Sep 06 01:30:30.481801 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.481756    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podStartSLOduration=1.481742606 podStartE2EDuration="1.481742606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:30.480442923 +0000 UTC m=+1298.805862901" watchObservedRunningTime="2026-09-06 01:30:30.481742606 +0000 UTC m=+1298.807162619"
Sep 06 01:30:30.922250 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:30.922161    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:31.927771 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:31.927740    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:32.473950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:32.473920    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:32.474911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:32.474889    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:33.720687 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.720653    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:30:33.724743 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.724713    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.727175 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.727144    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a7b006-serving-cert\""
Sep 06 01:30:33.734481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.734223    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:30:33.806683 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.806640    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.806875 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.806700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtw6t\" (UniqueName: \"kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.806875 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.806791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.907963 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.907925    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.908149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.907968    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtw6t\" (UniqueName: \"kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.908149 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.908009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.908149 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:30:33.908133    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-serving-cert: secret "maas-api-e2e-api-a-a7b006-serving-cert" not found
Sep 06 01:30:33.908287 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:30:33.908203    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls podName:64b99389-7ffb-407a-963f-cb7ae78676b9 nodeName:}" failed. No retries permitted until 2026-09-06 01:30:34.408186913 +0000 UTC m=+1302.733606868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls") pod "maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" (UID: "64b99389-7ffb-407a-963f-cb7ae78676b9") : secret "maas-api-e2e-api-a-a7b006-serving-cert" not found
Sep 06 01:30:33.908699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.908677    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:33.918398 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:33.918362    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtw6t\" (UniqueName: \"kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:34.413370 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:34.413321    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:34.415866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:34.415829    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") pod \"maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:34.638706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:34.638672    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:34.913856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:34.913822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:30:34.917586 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:30:34.917543    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b99389_7ffb_407a_963f_cb7ae78676b9.slice/crio-034d1041886563743e76e1bb42c775b06f90e60611f3d5fe264d74a9c82e7f6c WatchSource:0}: Error finding container 034d1041886563743e76e1bb42c775b06f90e60611f3d5fe264d74a9c82e7f6c: Status 404 returned error can't find the container with id 034d1041886563743e76e1bb42c775b06f90e60611f3d5fe264d74a9c82e7f6c
Sep 06 01:30:34.919910 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:34.919669    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:30:35.496781 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:35.496749    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" event={"ID":"64b99389-7ffb-407a-963f-cb7ae78676b9","Type":"ContainerStarted","Data":"034d1041886563743e76e1bb42c775b06f90e60611f3d5fe264d74a9c82e7f6c"}
Sep 06 01:30:36.505134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:36.505085    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" event={"ID":"64b99389-7ffb-407a-963f-cb7ae78676b9","Type":"ContainerStarted","Data":"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"}
Sep 06 01:30:36.505502 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:36.505189    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:36.522183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:36.522137    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" podStartSLOduration=2.925324222 podStartE2EDuration="3.522122263s" totalImagesPullingTime="596.798041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:36.520602226 +0000 UTC m=+1304.846022204" watchObservedRunningTime="2026-09-06 01:30:36.522122263 +0000 UTC m=+1304.847542230"
Sep 06 01:30:42.515988 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:42.515954    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:30:52.463604 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:52.463569    2557 scope.go:117] "RemoveContainer" containerID="768c01e4c7268bd938bf29ad31285267369f24f9826b88b770888134e7ab2c68"
Sep 06 01:30:52.472672 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:52.472648    2557 scope.go:117] "RemoveContainer" containerID="9d5347076747d12dade8d0b2a8bcfd5baf59fdfe598ca65ac2096927f625601d"
Sep 06 01:30:53.611333 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.611300    2557 generic.go:356] "Generic (PLEG): container finished" podID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerID="23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991" exitCode=0
Sep 06 01:30:53.611768 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.611363    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerDied","Data":"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"}
Sep 06 01:30:53.611816 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.611783    2557 scope.go:117] "RemoveContainer" containerID="23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"
Sep 06 01:30:53.612936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.612903    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:53.613022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.612973    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:53.613022 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:53.613004    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:54.619630 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:54.619591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerStarted","Data":"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"}
Sep 06 01:30:54.922584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:54.922497    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:30:54.922736 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:54.922701    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:54.922780 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:54.922758    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:30:55.921941 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:55.921898    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:55.922397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:55.921963    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:30:56.922786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:56.922753    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:56.923193 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:56.922807    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:30:57.922319 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:57.922284    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:57.922501 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:57.922341    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:30:58.290796 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.290762    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:30:58.295384 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.295363    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.297878 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.297858    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-20a262-openshift-default-dockercfg-pzpg2\""
Sep 06 01:30:58.304573 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.304310    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:30:58.382849 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.382811    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.382879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.382936    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.382978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.383000    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.383031    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.383077    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.383095    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgpjx\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.383252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.383168    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484376 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484334    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484470    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484565    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484822 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgpjx\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484822 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484720    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484931 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.484990 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.484967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.485125 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.485084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.485255 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.485209    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.485318 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.485263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.487165 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.486862    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.487326 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.487308    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.493939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.493914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.494236 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.494217    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgpjx\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx\") pod \"e2e-api-b-20a262-openshift-default-848b676db4-btvz7\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") " pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.608459 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.608373    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:30:58.908242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.908215    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:30:58.910618 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:30:58.910512    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453429c4_9f5c_40e0_b192_d09c34398091.slice/crio-2edf29bf66991cd40d0efb4b4119ded0d77551e2378b50a872ee80d25eda496f WatchSource:0}: Error finding container 2edf29bf66991cd40d0efb4b4119ded0d77551e2378b50a872ee80d25eda496f: Status 404 returned error can't find the container with id 2edf29bf66991cd40d0efb4b4119ded0d77551e2378b50a872ee80d25eda496f
Sep 06 01:30:58.913269 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.913231    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:58.913371 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.913321    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:58.913420 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.913369    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:30:58.922041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.922019    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:58.922132 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:58.922059    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:30:59.652536 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:59.652489    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerStarted","Data":"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"}
Sep 06 01:30:59.653065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:59.652565    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerStarted","Data":"2edf29bf66991cd40d0efb4b4119ded0d77551e2378b50a872ee80d25eda496f"}
Sep 06 01:30:59.678836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:59.678763    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podStartSLOduration=1.678741209 podStartE2EDuration="1.678741209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:30:59.674788227 +0000 UTC m=+1328.000208207" watchObservedRunningTime="2026-09-06 01:30:59.678741209 +0000 UTC m=+1328.004161187"
Sep 06 01:30:59.922691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:59.922604    2557 patch_prober.go:28] interesting pod/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 06 01:30:59.922691 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:30:59.922665    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 06 01:31:00.609157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.609117    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:00.614744 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.614714    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:00.658259 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.658232    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:00.659003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.658987    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:00.926252 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.926173    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:31:00.926586 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.926562    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:31:00.927266 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:00.927245    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:31:02.790534 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.790502    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:31:02.795227 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.795203    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.797440 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.797417    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-20a262-serving-cert\""
Sep 06 01:31:02.807517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.807485    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:31:02.829860 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.829828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx6xj\" (UniqueName: \"kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.830003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.829913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.830003 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.829964    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.931558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.931522    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.931756 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.931598    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.931756 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.931692    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx6xj\" (UniqueName: \"kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.931882 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:02.931759    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-serving-cert: secret "maas-api-e2e-api-b-20a262-serving-cert" not found
Sep 06 01:31:02.931882 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:02.931841    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls podName:6dbd2ad3-b7a5-4693-a160-36c10fae1adc nodeName:}" failed. No retries permitted until 2026-09-06 01:31:03.431819415 +0000 UTC m=+1331.757239369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls") pod "maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" (UID: "6dbd2ad3-b7a5-4693-a160-36c10fae1adc") : secret "maas-api-e2e-api-b-20a262-serving-cert" not found
Sep 06 01:31:02.932239 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.932219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:02.940084 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:02.940064    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx6xj\" (UniqueName: \"kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:03.437898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:03.437864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:03.440415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:03.440373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") pod \"maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:03.709099 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:03.709054    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:03.980988 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:03.980953    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:31:03.983317 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:31:03.983291    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbd2ad3_b7a5_4693_a160_36c10fae1adc.slice/crio-d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1 WatchSource:0}: Error finding container d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1: Status 404 returned error can't find the container with id d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1
Sep 06 01:31:04.682585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:04.682492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" event={"ID":"6dbd2ad3-b7a5-4693-a160-36c10fae1adc","Type":"ContainerStarted","Data":"99182d35842077e3d63324a1aa621f080b79b9789619be1c58dc70af2ebf0423"}
Sep 06 01:31:04.682585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:04.682551    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" event={"ID":"6dbd2ad3-b7a5-4693-a160-36c10fae1adc","Type":"ContainerStarted","Data":"d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1"}
Sep 06 01:31:04.682804 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:04.682602    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:04.699633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:04.699582    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" podStartSLOduration=2.3413116560000002 podStartE2EDuration="2.69956574s" totalImagesPullingTime="358.254084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:04.698293656 +0000 UTC m=+1333.023713634" watchObservedRunningTime="2026-09-06 01:31:04.69956574 +0000 UTC m=+1333.024985718"
Sep 06 01:31:10.693351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:10.693321    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:31:23.602754 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.602717    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:31:23.607079 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.607055    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.609763 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.609731    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-de7322-serving-cert\""
Sep 06 01:31:23.613989 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.613954    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:31:23.650385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.650355    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.650537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.650390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn76h\" (UniqueName: \"kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.650537 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.650460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.751594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.751557    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.751594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.751594    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn76h\" (UniqueName: \"kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.751835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.751657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.751887 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:23.751863    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-serving-cert: secret "maas-api-e2e-ipp-a-de7322-serving-cert" not found
Sep 06 01:31:23.751974 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:23.751962    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls podName:b151954e-1f62-4453-8d2f-6ea843e9a8d2 nodeName:}" failed. No retries permitted until 2026-09-06 01:31:24.251938581 +0000 UTC m=+1352.577358540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls") pod "maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" (UID: "b151954e-1f62-4453-8d2f-6ea843e9a8d2") : secret "maas-api-e2e-ipp-a-de7322-serving-cert" not found
Sep 06 01:31:23.752320 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.752300    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.760275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.760247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn76h\" (UniqueName: \"kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:23.804574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.804548    2557 generic.go:356] "Generic (PLEG): container finished" podID="453429c4-9f5c-40e0-b192-d09c34398091" containerID="4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8" exitCode=0
Sep 06 01:31:23.804724 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.804631    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerDied","Data":"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"}
Sep 06 01:31:23.805065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.805051    2557 scope.go:117] "RemoveContainer" containerID="4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"
Sep 06 01:31:23.806241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.806216    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:31:23.806303 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.806286    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:31:23.806340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:23.806321    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:31:24.256055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.256018    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:24.258669 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.258641    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:24.521087 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.521012    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:24.793256 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.793226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:31:24.795168 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:31:24.795141    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb151954e_1f62_4453_8d2f_6ea843e9a8d2.slice/crio-4e31dc316db29a918313ec86e0736a80edc07987c66c92f2fd1474c2389acbd5 WatchSource:0}: Error finding container 4e31dc316db29a918313ec86e0736a80edc07987c66c92f2fd1474c2389acbd5: Status 404 returned error can't find the container with id 4e31dc316db29a918313ec86e0736a80edc07987c66c92f2fd1474c2389acbd5
Sep 06 01:31:24.811786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.811753    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" event={"ID":"b151954e-1f62-4453-8d2f-6ea843e9a8d2","Type":"ContainerStarted","Data":"4e31dc316db29a918313ec86e0736a80edc07987c66c92f2fd1474c2389acbd5"}
Sep 06 01:31:24.813705 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:24.813679    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerStarted","Data":"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"}
Sep 06 01:31:25.608811 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:25.608770    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:25.609046 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:25.609024    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:25.609094 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:25.609073    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:25.824004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:25.823963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" event={"ID":"b151954e-1f62-4453-8d2f-6ea843e9a8d2","Type":"ContainerStarted","Data":"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"}
Sep 06 01:31:25.824444 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:25.824043    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:26.608925 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:26.608885    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:26.609120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:26.608949    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:27.609092 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:27.609051    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:27.609507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:27.609132    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:28.609072 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:28.609036    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:28.609293 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:28.609116    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:29.608885 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:29.608850    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:29.609025 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:29.608918    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:30.609558 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:30.609521    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 06 01:31:30.610033 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:30.609583    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 06 01:31:30.659086 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:30.659051    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:31.612960 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:31.612927    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:31.613968 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:31.613948    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:31:31.634635 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:31.634589    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" podStartSLOduration=8.283303782 podStartE2EDuration="8.634575703s" totalImagesPullingTime="351.271921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:25.860711865 +0000 UTC m=+1354.186131843" watchObservedRunningTime="2026-09-06 01:31:31.634575703 +0000 UTC m=+1359.959995687"
Sep 06 01:31:31.837825 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:31.837799    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:31:45.470796 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.470754    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:31:45.471711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.470980    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" podUID="64b99389-7ffb-407a-963f-cb7ae78676b9" containerName="maas-api" containerID="cri-o://b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96" gracePeriod=30
Sep 06 01:31:45.727896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.727835    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:31:45.885814 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.885788    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") pod \"64b99389-7ffb-407a-963f-cb7ae78676b9\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") "
Sep 06 01:31:45.885996 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.885830    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtw6t\" (UniqueName: \"kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t\") pod \"64b99389-7ffb-407a-963f-cb7ae78676b9\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") "
Sep 06 01:31:45.885996 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.885863    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca\") pod \"64b99389-7ffb-407a-963f-cb7ae78676b9\" (UID: \"64b99389-7ffb-407a-963f-cb7ae78676b9\") "
Sep 06 01:31:45.886284 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.886247    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64b99389-7ffb-407a-963f-cb7ae78676b9" (UID: "64b99389-7ffb-407a-963f-cb7ae78676b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:45.888012 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.887984    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64b99389-7ffb-407a-963f-cb7ae78676b9" (UID: "64b99389-7ffb-407a-963f-cb7ae78676b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:31:45.888144 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.888045    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t" (OuterVolumeSpecName: "kube-api-access-gtw6t") pod "64b99389-7ffb-407a-963f-cb7ae78676b9" (UID: "64b99389-7ffb-407a-963f-cb7ae78676b9"). InnerVolumeSpecName "kube-api-access-gtw6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:45.944692 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.944661    2557 generic.go:356] "Generic (PLEG): container finished" podID="64b99389-7ffb-407a-963f-cb7ae78676b9" containerID="b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96" exitCode=0
Sep 06 01:31:45.944856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.944716    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"
Sep 06 01:31:45.944856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.944756    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" event={"ID":"64b99389-7ffb-407a-963f-cb7ae78676b9","Type":"ContainerDied","Data":"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"}
Sep 06 01:31:45.944856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.944830    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq" event={"ID":"64b99389-7ffb-407a-963f-cb7ae78676b9","Type":"ContainerDied","Data":"034d1041886563743e76e1bb42c775b06f90e60611f3d5fe264d74a9c82e7f6c"}
Sep 06 01:31:45.945032 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.944860    2557 scope.go:117] "RemoveContainer" containerID="b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"
Sep 06 01:31:45.954754 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.954735    2557 scope.go:117] "RemoveContainer" containerID="b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"
Sep 06 01:31:45.955015 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:45.954993    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96\": container with ID starting with b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96 not found: ID does not exist" containerID="b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"
Sep 06 01:31:45.955080 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.955022    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96"} err="failed to get container status \"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96\": rpc error: code = NotFound desc = could not find container \"b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96\": container with ID starting with b627429cf520f9d45c03c610567afe39da9cf3fd76664345a552ed1d1a694e96 not found: ID does not exist"
Sep 06 01:31:45.966671 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.966649    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:31:45.972209 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.972190    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a7b006-678cc6c7b-q7gzq"]
Sep 06 01:31:45.987520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.987470    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64b99389-7ffb-407a-963f-cb7ae78676b9-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:45.987520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.987492    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtw6t\" (UniqueName: \"kubernetes.io/projected/64b99389-7ffb-407a-963f-cb7ae78676b9-kube-api-access-gtw6t\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:45.987520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:45.987503    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b99389-7ffb-407a-963f-cb7ae78676b9-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:46.163864 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:46.163831    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b99389-7ffb-407a-963f-cb7ae78676b9" path="/var/lib/kubelet/pods/64b99389-7ffb-407a-963f-cb7ae78676b9/volumes"
Sep 06 01:31:52.643542 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.643510    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:31:52.644008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.643749    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy" containerID="cri-o://8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495" gracePeriod=30
Sep 06 01:31:52.902830 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.902732    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:31:52.903506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.903479    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b99389-7ffb-407a-963f-cb7ae78676b9" containerName="maas-api"
Sep 06 01:31:52.903506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.903505    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b99389-7ffb-407a-963f-cb7ae78676b9" containerName="maas-api"
Sep 06 01:31:52.903711 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.903624    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b99389-7ffb-407a-963f-cb7ae78676b9" containerName="maas-api"
Sep 06 01:31:52.907980 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.907960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:52.910538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.910520    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-0b81e1-serving-cert\""
Sep 06 01:31:52.918979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:52.918824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:31:53.060566 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.060528    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.060763 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.060597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.060763 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.060653    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbr77\" (UniqueName: \"kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.161358 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.161276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbr77\" (UniqueName: \"kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.161521 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.161363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.161521 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.161428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.161641 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:53.161524    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-serving-cert: secret "maas-api-e2e-ipp-b-0b81e1-serving-cert" not found
Sep 06 01:31:53.161641 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:53.161590    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls podName:ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0 nodeName:}" failed. No retries permitted until 2026-09-06 01:31:53.661574242 +0000 UTC m=+1381.986994197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls") pod "maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" (UID: "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0") : secret "maas-api-e2e-ipp-b-0b81e1-serving-cert" not found
Sep 06 01:31:53.162026 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.162009    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.170809 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.170783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbr77\" (UniqueName: \"kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.667373 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.667343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.669890 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.669860    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") pod \"maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:53.820546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:53.820508    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:54.095085 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:54.095060    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:31:54.097178 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:31:54.097151    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae68df3c_08e1_4b7d_a1a4_e1b5f47cd1b0.slice/crio-f892442d8bbb9a80fd774818c648ad52afcd28aa1d708b4c76f67fe34f8bcbcc WatchSource:0}: Error finding container f892442d8bbb9a80fd774818c648ad52afcd28aa1d708b4c76f67fe34f8bcbcc: Status 404 returned error can't find the container with id f892442d8bbb9a80fd774818c648ad52afcd28aa1d708b4c76f67fe34f8bcbcc
Sep 06 01:31:54.998839 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:54.998798    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" event={"ID":"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0","Type":"ContainerStarted","Data":"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"}
Sep 06 01:31:54.999299 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:54.998858    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" event={"ID":"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0","Type":"ContainerStarted","Data":"f892442d8bbb9a80fd774818c648ad52afcd28aa1d708b4c76f67fe34f8bcbcc"}
Sep 06 01:31:54.999299 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:54.998901    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:31:55.016204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:55.016162    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" podStartSLOduration=2.61632115 podStartE2EDuration="3.016150097s" totalImagesPullingTime="399.828947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:31:55.014426671 +0000 UTC m=+1383.339846648" watchObservedRunningTime="2026-09-06 01:31:55.016150097 +0000 UTC m=+1383.341570101"
Sep 06 01:31:57.907346 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:57.907283    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:31:58.011369 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011333    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011369 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011375    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011421    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011474    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011495    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011524    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbjnm\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011592 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011559    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011845 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011595    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011845 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy\") pod \"c63b5ad1-d935-40a9-974d-6c85cec632bb\" (UID: \"c63b5ad1-d935-40a9-974d-6c85cec632bb\") "
Sep 06 01:31:58.011845 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011585    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:58.012008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011813    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:58.012008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.011825    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:58.012008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.012003    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.012200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.012023    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:58.012271 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.012202    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:31:58.013888 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.013864    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:58.014020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.013900    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm" (OuterVolumeSpecName: "kube-api-access-cbjnm") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "kube-api-access-cbjnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:31:58.014020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.013961    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:31:58.014122 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.014041    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c63b5ad1-d935-40a9-974d-6c85cec632bb" (UID: "c63b5ad1-d935-40a9-974d-6c85cec632bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:31:58.019019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.018998    2557 generic.go:356] "Generic (PLEG): container finished" podID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerID="8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495" exitCode=0
Sep 06 01:31:58.019140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.019050    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"
Sep 06 01:31:58.019140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.019062    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerDied","Data":"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"}
Sep 06 01:31:58.019140 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.019133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx" event={"ID":"c63b5ad1-d935-40a9-974d-6c85cec632bb","Type":"ContainerDied","Data":"04ac07e6f16856621325a1ceeee53229c656818750aa3f3a8be0b5ab6e694661"}
Sep 06 01:31:58.019273 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.019159    2557 scope.go:117] "RemoveContainer" containerID="8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"
Sep 06 01:31:58.036020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.036002    2557 scope.go:117] "RemoveContainer" containerID="23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"
Sep 06 01:31:58.044943 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.044923    2557 scope.go:117] "RemoveContainer" containerID="8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"
Sep 06 01:31:58.045467 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:58.045443    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495\": container with ID starting with 8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495 not found: ID does not exist" containerID="8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"
Sep 06 01:31:58.045576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.045477    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495"} err="failed to get container status \"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495\": rpc error: code = NotFound desc = could not find container \"8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495\": container with ID starting with 8defea3681b9ca47dfc6ee0131968482784752f82ccaa14855a1f0229b51e495 not found: ID does not exist"
Sep 06 01:31:58.045576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.045499    2557 scope.go:117] "RemoveContainer" containerID="23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"
Sep 06 01:31:58.045827 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:31:58.045806    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991\": container with ID starting with 23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991 not found: ID does not exist" containerID="23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"
Sep 06 01:31:58.045897 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.045837    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991"} err="failed to get container status \"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991\": rpc error: code = NotFound desc = could not find container \"23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991\": container with ID starting with 23aaa385a6fade902d70e473b9145775905073a518a2e85991d0abb8fd9d5991 not found: ID does not exist"
Sep 06 01:31:58.048959 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.048938    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:31:58.055129 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.055092    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a7b006-openshift-default-7b68c89f84-skfdx"]
Sep 06 01:31:58.112560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112526    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112556    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112560 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112565    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbjnm\" (UniqueName: \"kubernetes.io/projected/c63b5ad1-d935-40a9-974d-6c85cec632bb-kube-api-access-cbjnm\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112581    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112592    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112600    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112609    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c63b5ad1-d935-40a9-974d-6c85cec632bb-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.112778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.112616    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c63b5ad1-d935-40a9-974d-6c85cec632bb-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:31:58.163856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:31:58.163782    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" path="/var/lib/kubelet/pods/c63b5ad1-d935-40a9-974d-6c85cec632bb/volumes"
Sep 06 01:32:01.010285 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:01.010250    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:32:08.830715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:08.830674    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:32:08.831205 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:08.830944    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" podUID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" containerName="maas-api" containerID="cri-o://99182d35842077e3d63324a1aa621f080b79b9789619be1c58dc70af2ebf0423" gracePeriod=30
Sep 06 01:32:09.085245 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.085169    2557 generic.go:356] "Generic (PLEG): container finished" podID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" containerID="99182d35842077e3d63324a1aa621f080b79b9789619be1c58dc70af2ebf0423" exitCode=0
Sep 06 01:32:09.085370 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.085236    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" event={"ID":"6dbd2ad3-b7a5-4693-a160-36c10fae1adc","Type":"ContainerDied","Data":"99182d35842077e3d63324a1aa621f080b79b9789619be1c58dc70af2ebf0423"}
Sep 06 01:32:09.085370 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.085293    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl" event={"ID":"6dbd2ad3-b7a5-4693-a160-36c10fae1adc","Type":"ContainerDied","Data":"d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1"}
Sep 06 01:32:09.085370 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.085317    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d3182e579163b5a2afc69cafe81cf39d29287ef076d4ac3a75e981f594bdd9b1"
Sep 06 01:32:09.088614 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.088597    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:32:09.229777 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.229743    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx6xj\" (UniqueName: \"kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj\") pod \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") "
Sep 06 01:32:09.229940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.229785    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") pod \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") "
Sep 06 01:32:09.229940 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.229897    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca\") pod \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\" (UID: \"6dbd2ad3-b7a5-4693-a160-36c10fae1adc\") "
Sep 06 01:32:09.230292 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.230264    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6dbd2ad3-b7a5-4693-a160-36c10fae1adc" (UID: "6dbd2ad3-b7a5-4693-a160-36c10fae1adc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:09.231952 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.231928    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6dbd2ad3-b7a5-4693-a160-36c10fae1adc" (UID: "6dbd2ad3-b7a5-4693-a160-36c10fae1adc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:32:09.232068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.231945    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj" (OuterVolumeSpecName: "kube-api-access-dx6xj") pod "6dbd2ad3-b7a5-4693-a160-36c10fae1adc" (UID: "6dbd2ad3-b7a5-4693-a160-36c10fae1adc"). InnerVolumeSpecName "kube-api-access-dx6xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:09.330906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.330870    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx6xj\" (UniqueName: \"kubernetes.io/projected/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-kube-api-access-dx6xj\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.330906 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.330901    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:09.331129 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:09.330924    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dbd2ad3-b7a5-4693-a160-36c10fae1adc-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:10.090710 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:10.090680    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"
Sep 06 01:32:10.111529 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:10.111502    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:32:10.113754 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:10.113730    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-20a262-9b7b55d9d-74nsl"]
Sep 06 01:32:10.163893 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:10.163859    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" path="/var/lib/kubelet/pods/6dbd2ad3-b7a5-4693-a160-36c10fae1adc/volumes"
Sep 06 01:32:15.688922 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:15.688884    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:32:15.689378 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:15.689181    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" containerID="cri-o://b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a" gracePeriod=30
Sep 06 01:32:16.615939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:16.615898    2557 patch_prober.go:28] interesting pod/e2e-api-b-20a262-openshift-default-848b676db4-btvz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:32:16.616141 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:16.615962    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:32:20.948254 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:20.948222    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:32:21.041675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041609    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041671    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041775    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041817    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgpjx\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041849    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.041872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041873    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.042197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.041920    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data\") pod \"453429c4-9f5c-40e0-b192-d09c34398091\" (UID: \"453429c4-9f5c-40e0-b192-d09c34398091\") "
Sep 06 01:32:21.042197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042044    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:21.042197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042057    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:21.042197 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042072    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:21.042385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042353    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.042385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042373    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.042489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042389    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.042489 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042391    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data" (OuterVolumeSpecName: "istio-data") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:21.042640 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.042611    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:21.044427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.044401    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:21.044677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.044643    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx" (OuterVolumeSpecName: "kube-api-access-lgpjx") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "kube-api-access-lgpjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:21.044787 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.044691    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:32:21.044787 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.044713    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token" (OuterVolumeSpecName: "istio-token") pod "453429c4-9f5c-40e0-b192-d09c34398091" (UID: "453429c4-9f5c-40e0-b192-d09c34398091"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:21.143436 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143395    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/453429c4-9f5c-40e0-b192-d09c34398091-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.143436 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143430    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgpjx\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-kube-api-access-lgpjx\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.143675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143447    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.143675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143460    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/453429c4-9f5c-40e0-b192-d09c34398091-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.143675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143472    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/453429c4-9f5c-40e0-b192-d09c34398091-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.143675 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.143485    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/453429c4-9f5c-40e0-b192-d09c34398091-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:21.150969 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.150935    2557 generic.go:356] "Generic (PLEG): container finished" podID="453429c4-9f5c-40e0-b192-d09c34398091" containerID="b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a" exitCode=0
Sep 06 01:32:21.151216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.151004    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"
Sep 06 01:32:21.151216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.151018    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerDied","Data":"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"}
Sep 06 01:32:21.151216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.151073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7" event={"ID":"453429c4-9f5c-40e0-b192-d09c34398091","Type":"ContainerDied","Data":"2edf29bf66991cd40d0efb4b4119ded0d77551e2378b50a872ee80d25eda496f"}
Sep 06 01:32:21.151216 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.151096    2557 scope.go:117] "RemoveContainer" containerID="b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"
Sep 06 01:32:21.160806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.160790    2557 scope.go:117] "RemoveContainer" containerID="4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"
Sep 06 01:32:21.169714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.169697    2557 scope.go:117] "RemoveContainer" containerID="b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"
Sep 06 01:32:21.170031 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:21.170011    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a\": container with ID starting with b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a not found: ID does not exist" containerID="b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"
Sep 06 01:32:21.170135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.170039    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a"} err="failed to get container status \"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a\": rpc error: code = NotFound desc = could not find container \"b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a\": container with ID starting with b83f5056a913aab2925a786a7fd63b068f830c964500ae1ee4b274383478d59a not found: ID does not exist"
Sep 06 01:32:21.170135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.170058    2557 scope.go:117] "RemoveContainer" containerID="4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"
Sep 06 01:32:21.170484 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:21.170435    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8\": container with ID starting with 4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8 not found: ID does not exist" containerID="4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"
Sep 06 01:32:21.170585 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.170504    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8"} err="failed to get container status \"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8\": rpc error: code = NotFound desc = could not find container \"4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8\": container with ID starting with 4cc57f7f432cd866821b89fe20f55b67302e194365c8f3e07044992c4687ffd8 not found: ID does not exist"
Sep 06 01:32:21.173230 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.173211    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:32:21.179027 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:21.179004    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-20a262-openshift-default-848b676db4-btvz7"]
Sep 06 01:32:22.163868 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:22.163827    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="453429c4-9f5c-40e0-b192-d09c34398091" path="/var/lib/kubelet/pods/453429c4-9f5c-40e0-b192-d09c34398091/volumes"
Sep 06 01:32:26.409327 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.409281    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:32:26.409791 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.409574    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" podUID="c2b30e2a-0788-49cf-96a6-948351b7e084" containerName="maas-api" containerID="cri-o://525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1" gracePeriod=30
Sep 06 01:32:26.672081 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.672022    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:32:26.797760 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.797731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca\") pod \"c2b30e2a-0788-49cf-96a6-948351b7e084\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") "
Sep 06 01:32:26.797936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.797782    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") pod \"c2b30e2a-0788-49cf-96a6-948351b7e084\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") "
Sep 06 01:32:26.797936 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.797822    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdqwz\" (UniqueName: \"kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz\") pod \"c2b30e2a-0788-49cf-96a6-948351b7e084\" (UID: \"c2b30e2a-0788-49cf-96a6-948351b7e084\") "
Sep 06 01:32:26.798119 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.798074    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2b30e2a-0788-49cf-96a6-948351b7e084" (UID: "c2b30e2a-0788-49cf-96a6-948351b7e084"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:26.798235 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.798218    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2b30e2a-0788-49cf-96a6-948351b7e084-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:26.799938 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.799913    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2b30e2a-0788-49cf-96a6-948351b7e084" (UID: "c2b30e2a-0788-49cf-96a6-948351b7e084"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:32:26.800054 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.799986    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz" (OuterVolumeSpecName: "kube-api-access-sdqwz") pod "c2b30e2a-0788-49cf-96a6-948351b7e084" (UID: "c2b30e2a-0788-49cf-96a6-948351b7e084"). InnerVolumeSpecName "kube-api-access-sdqwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:26.899422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.899391    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2b30e2a-0788-49cf-96a6-948351b7e084-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:26.899422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:26.899418    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdqwz\" (UniqueName: \"kubernetes.io/projected/c2b30e2a-0788-49cf-96a6-948351b7e084-kube-api-access-sdqwz\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:27.185713 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.185682    2557 generic.go:356] "Generic (PLEG): container finished" podID="c2b30e2a-0788-49cf-96a6-948351b7e084" containerID="525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1" exitCode=0
Sep 06 01:32:27.185872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.185716    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"
Sep 06 01:32:27.185872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.185764    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" event={"ID":"c2b30e2a-0788-49cf-96a6-948351b7e084","Type":"ContainerDied","Data":"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"}
Sep 06 01:32:27.185872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.185811    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q" event={"ID":"c2b30e2a-0788-49cf-96a6-948351b7e084","Type":"ContainerDied","Data":"14dae84db070682bebf509ea1b63a5691297beb594a2cd95747ecd5deef5d1c3"}
Sep 06 01:32:27.185872 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.185832    2557 scope.go:117] "RemoveContainer" containerID="525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"
Sep 06 01:32:27.195357 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.195340    2557 scope.go:117] "RemoveContainer" containerID="525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"
Sep 06 01:32:27.195609 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:27.195589    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1\": container with ID starting with 525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1 not found: ID does not exist" containerID="525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"
Sep 06 01:32:27.195688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.195619    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1"} err="failed to get container status \"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1\": rpc error: code = NotFound desc = could not find container \"525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1\": container with ID starting with 525b1881430d0268bcd2a84e660a8b1ae6c504256193d5d69334a097973312c1 not found: ID does not exist"
Sep 06 01:32:27.206576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.206553    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:32:27.210528 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:27.210507    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-49c9de-559cff4f7f-cmn6q"]
Sep 06 01:32:28.171193 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:28.171156    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b30e2a-0788-49cf-96a6-948351b7e084" path="/var/lib/kubelet/pods/c2b30e2a-0788-49cf-96a6-948351b7e084/volumes"
Sep 06 01:32:32.982124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:32.980972    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:32:32.982124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:32.981996    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy" containerID="cri-o://89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e" gracePeriod=30
Sep 06 01:32:38.241302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.241274    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:32:38.247379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.247307    2557 generic.go:356] "Generic (PLEG): container finished" podID="1aedda1c-de6e-4f3e-86da-675900857982" containerID="89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e" exitCode=0
Sep 06 01:32:38.247511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.247371    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"
Sep 06 01:32:38.247511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.247390    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerDied","Data":"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"}
Sep 06 01:32:38.247511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.247454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf" event={"ID":"1aedda1c-de6e-4f3e-86da-675900857982","Type":"ContainerDied","Data":"1d72738ba981d42d172174481997c1205e329562800656846d2a6ac8fec44209"}
Sep 06 01:32:38.247511 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.247488    2557 scope.go:117] "RemoveContainer" containerID="89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"
Sep 06 01:32:38.256426 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.256409    2557 scope.go:117] "RemoveContainer" containerID="8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"
Sep 06 01:32:38.265701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.265677    2557 scope.go:117] "RemoveContainer" containerID="89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"
Sep 06 01:32:38.266057 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:38.266037    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e\": container with ID starting with 89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e not found: ID does not exist" containerID="89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"
Sep 06 01:32:38.266196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.266066    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e"} err="failed to get container status \"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e\": rpc error: code = NotFound desc = could not find container \"89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e\": container with ID starting with 89d9ccf9cf26911af6204a1caf956af8779a753bc7e2755e31fa5d9f9c79b38e not found: ID does not exist"
Sep 06 01:32:38.266196 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.266083    2557 scope.go:117] "RemoveContainer" containerID="8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"
Sep 06 01:32:38.266443 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:38.266423    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1\": container with ID starting with 8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1 not found: ID does not exist" containerID="8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"
Sep 06 01:32:38.266502 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.266457    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1"} err="failed to get container status \"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1\": rpc error: code = NotFound desc = could not find container \"8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1\": container with ID starting with 8405443a91fec12b8f07f80a43aa555e1e79e5c4f4824e7b6e890be0521f5ab1 not found: ID does not exist"
Sep 06 01:32:38.306746 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306718    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.306889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306768    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.306889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306796    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.306889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306823    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.306889 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306852    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.307134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306907    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx2mh\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.307134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.306963    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.307134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307010    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:38.307134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307030    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.307134 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307073    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token\") pod \"1aedda1c-de6e-4f3e-86da-675900857982\" (UID: \"1aedda1c-de6e-4f3e-86da-675900857982\") "
Sep 06 01:32:38.307416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307098    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:38.307416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data" (OuterVolumeSpecName: "istio-data") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:38.307416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307267    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:38.307416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307345    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:38.307416 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307395    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.307627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307421    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.307627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307437    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.307627 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.307450    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.309048 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.309023    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:38.309178 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.309025    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:32:38.309623 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.309603    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh" (OuterVolumeSpecName: "kube-api-access-gx2mh") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "kube-api-access-gx2mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:38.309688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.309615    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token" (OuterVolumeSpecName: "istio-token") pod "1aedda1c-de6e-4f3e-86da-675900857982" (UID: "1aedda1c-de6e-4f3e-86da-675900857982"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:38.407899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.407870    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.407899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.407893    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aedda1c-de6e-4f3e-86da-675900857982-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.407899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.407902    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aedda1c-de6e-4f3e-86da-675900857982-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.408135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.407911    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx2mh\" (UniqueName: \"kubernetes.io/projected/1aedda1c-de6e-4f3e-86da-675900857982-kube-api-access-gx2mh\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.408135 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.407920    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aedda1c-de6e-4f3e-86da-675900857982-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:38.572913 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.572885    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:32:38.579024 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:38.579000    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-49c9de-openshift-default-5687757f6b-h8ggf"]
Sep 06 01:32:40.163974 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:40.163940    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aedda1c-de6e-4f3e-86da-675900857982" path="/var/lib/kubelet/pods/1aedda1c-de6e-4f3e-86da-675900857982/volumes"
Sep 06 01:32:43.820382 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:43.820349    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:32:43.820801 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:43.820557    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerName="maas-api" containerID="cri-o://63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075" gracePeriod=30
Sep 06 01:32:44.092782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.092754    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:32:44.166506 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.166463    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls\") pod \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") "
Sep 06 01:32:44.166688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.166529    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca\") pod \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") "
Sep 06 01:32:44.166688 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.166609    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvnxs\" (UniqueName: \"kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs\") pod \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\" (UID: \"6d129b83-0d9a-4e97-b0f0-70e6e622dc56\") "
Sep 06 01:32:44.167204 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.167172    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d129b83-0d9a-4e97-b0f0-70e6e622dc56" (UID: "6d129b83-0d9a-4e97-b0f0-70e6e622dc56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:44.169192 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.169160    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d129b83-0d9a-4e97-b0f0-70e6e622dc56" (UID: "6d129b83-0d9a-4e97-b0f0-70e6e622dc56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:32:44.169491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.169469    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs" (OuterVolumeSpecName: "kube-api-access-gvnxs") pod "6d129b83-0d9a-4e97-b0f0-70e6e622dc56" (UID: "6d129b83-0d9a-4e97-b0f0-70e6e622dc56"). InnerVolumeSpecName "kube-api-access-gvnxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:44.268198 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.268085    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.268198 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.268147    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.268198 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.268161    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvnxs\" (UniqueName: \"kubernetes.io/projected/6d129b83-0d9a-4e97-b0f0-70e6e622dc56-kube-api-access-gvnxs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:44.283747 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.283709    2557 generic.go:356] "Generic (PLEG): container finished" podID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerID="63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075" exitCode=0
Sep 06 01:32:44.283912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.283757    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"
Sep 06 01:32:44.283912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.283796    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" event={"ID":"6d129b83-0d9a-4e97-b0f0-70e6e622dc56","Type":"ContainerDied","Data":"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"}
Sep 06 01:32:44.283912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.283850    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" event={"ID":"6d129b83-0d9a-4e97-b0f0-70e6e622dc56","Type":"ContainerDied","Data":"303fa714a5a08bcbb55fc62595ecaeb0c6c9a84c5e9323172e2537270afa60fa"}
Sep 06 01:32:44.283912 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.283872    2557 scope.go:117] "RemoveContainer" containerID="63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"
Sep 06 01:32:44.293150 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.293135    2557 scope.go:117] "RemoveContainer" containerID="63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"
Sep 06 01:32:44.293416 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:44.293397    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075\": container with ID starting with 63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075 not found: ID does not exist" containerID="63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"
Sep 06 01:32:44.293464 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.293422    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075"} err="failed to get container status \"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075\": rpc error: code = NotFound desc = could not find container \"63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075\": container with ID starting with 63e9c9c5a76839d86da01c4906f49be6509709f743857eafa4d99295b9950075 not found: ID does not exist"
Sep 06 01:32:44.305403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.305378    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:32:44.308820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:44.308798    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj"]
Sep 06 01:32:46.164487 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:46.164452    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" path="/var/lib/kubelet/pods/6d129b83-0d9a-4e97-b0f0-70e6e622dc56/volumes"
Sep 06 01:32:47.060082 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:47.060033    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff89d-6c79599cc-gm6bj" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.80:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 06 01:32:50.364706 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:50.364667    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:32:50.365203 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:50.364923    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy" containerID="cri-o://d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46" gracePeriod=30
Sep 06 01:32:55.620783 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.620754    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:32:55.775311 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775279    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775311 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775318    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775345    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775369    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775393    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775449    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bxmr\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775505    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775550    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775569    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:55.775892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775624    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:55.775892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775673    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert\") pod \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\" (UID: \"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4\") "
Sep 06 01:32:55.775892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:55.776087 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.775974    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:32:55.776183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.776083    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.776183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.776126    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.776183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.776141    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.776183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.776155    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.776183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.776095    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:55.777792 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.777760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:32:55.777792 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.777763    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:32:55.777792 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.777760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr" (OuterVolumeSpecName: "kube-api-access-8bxmr") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "kube-api-access-8bxmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:55.778035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.777815    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" (UID: "7bc259d7-f437-4a35-af5e-4a1fdfdc81b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:32:55.877445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.877407    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.877445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.877438    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.877445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.877446    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.877445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.877454    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bxmr\" (UniqueName: \"kubernetes.io/projected/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-kube-api-access-8bxmr\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:55.877715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:55.877463    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:32:56.352783 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.352745    2557 generic.go:356] "Generic (PLEG): container finished" podID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerID="d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46" exitCode=0
Sep 06 01:32:56.352954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.352800    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"
Sep 06 01:32:56.352954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.352833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerDied","Data":"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"}
Sep 06 01:32:56.352954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.352893    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc" event={"ID":"7bc259d7-f437-4a35-af5e-4a1fdfdc81b4","Type":"ContainerDied","Data":"ad6112482fb4188f6773d58928d888df6c27d503841fb90b5b85abff8e19a71e"}
Sep 06 01:32:56.352954 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.352925    2557 scope.go:117] "RemoveContainer" containerID="d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"
Sep 06 01:32:56.362317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.362295    2557 scope.go:117] "RemoveContainer" containerID="0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"
Sep 06 01:32:56.370522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.370499    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:32:56.371256 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.371235    2557 scope.go:117] "RemoveContainer" containerID="d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"
Sep 06 01:32:56.371511 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:56.371494    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46\": container with ID starting with d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46 not found: ID does not exist" containerID="d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"
Sep 06 01:32:56.371566 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.371519    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46"} err="failed to get container status \"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46\": rpc error: code = NotFound desc = could not find container \"d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46\": container with ID starting with d7aa19d4927484b16ea1a3b6c89669daac623df22b0b2a3bb4fea853d4159f46 not found: ID does not exist"
Sep 06 01:32:56.371566 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.371538    2557 scope.go:117] "RemoveContainer" containerID="0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"
Sep 06 01:32:56.371799 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:32:56.371780    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc\": container with ID starting with 0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc not found: ID does not exist" containerID="0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"
Sep 06 01:32:56.371859 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.371809    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc"} err="failed to get container status \"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc\": rpc error: code = NotFound desc = could not find container \"0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc\": container with ID starting with 0d8b49f03845ae62ba0a1a5c2cef356328418e9a5ce6d96a04172c3a582d54dc not found: ID does not exist"
Sep 06 01:32:56.376137 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:56.376113    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-bff89d-openshift-default-8645fb7986-p4rfc"]
Sep 06 01:32:58.164004 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:32:58.163968    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" path="/var/lib/kubelet/pods/7bc259d7-f437-4a35-af5e-4a1fdfdc81b4/volumes"
Sep 06 01:33:23.993996 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.993963    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994384    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994398    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994410    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994418    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994432    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994440    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994451    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994456    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994463    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b30e2a-0788-49cf-96a6-948351b7e084" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994468    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b30e2a-0788-49cf-96a6-948351b7e084" containerName="maas-api"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994484    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994490    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994498    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994504    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994519    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.994561 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994524    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994599    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994611    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994622    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994630    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994639    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dbd2ad3-b7a5-4693-a160-36c10fae1adc" containerName="maas-api"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994648    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994657    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b30e2a-0788-49cf-96a6-948351b7e084" containerName="maas-api"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994665    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994676    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bc259d7-f437-4a35-af5e-4a1fdfdc81b4" containerName="istio-proxy"
Sep 06 01:33:23.995120 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.994686    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d129b83-0d9a-4e97-b0f0-70e6e622dc56" containerName="maas-api"
Sep 06 01:33:23.997785 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:23.997768    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.000198 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.000178    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-e805e0-openshift-default-dockercfg-htkm7\""
Sep 06 01:33:24.009918 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.009896    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:33:24.122564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122566    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbhnw\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122786    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.122833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122809    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.123068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122850    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.123068 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.122907    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.223724 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223691    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.223724 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224001 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224001 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223770    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224001 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224001 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.223878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224166    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbhnw\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224197    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224253    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224554 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.224720 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.224703    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.226397 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.226374    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.226505 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.226482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.231242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.231222    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.231454 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.231434    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbhnw\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw\") pod \"e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") " pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.308729 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.308653    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:24.588659 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.588637    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:33:24.590484 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:33:24.590450    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a59ebc3_e7a2_4a9c_992a_0e9923f767a5.slice/crio-db106ea83a5d5c8a20269889ae6c11615ff6a7d81c4c2b794de9efd645b35a2e WatchSource:0}: Error finding container db106ea83a5d5c8a20269889ae6c11615ff6a7d81c4c2b794de9efd645b35a2e: Status 404 returned error can't find the container with id db106ea83a5d5c8a20269889ae6c11615ff6a7d81c4c2b794de9efd645b35a2e
Sep 06 01:33:24.592842 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.592801    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:24.592948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.592899    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:24.592990 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:24.592948    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:25.512491 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:25.512452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerStarted","Data":"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"}
Sep 06 01:33:25.512880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:25.512540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerStarted","Data":"db106ea83a5d5c8a20269889ae6c11615ff6a7d81c4c2b794de9efd645b35a2e"}
Sep 06 01:33:25.535984 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:25.535905    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podStartSLOduration=2.535884099 podStartE2EDuration="2.535884099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:33:25.532834291 +0000 UTC m=+1473.858254269" watchObservedRunningTime="2026-09-06 01:33:25.535884099 +0000 UTC m=+1473.861304077"
Sep 06 01:33:26.308959 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:26.308915    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:26.314272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:26.314239    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:26.518332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:26.518299    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:26.519289 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:26.519270    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:28.702369 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.702337    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:33:28.702971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.702950    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:28.703071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.702973    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c63b5ad1-d935-40a9-974d-6c85cec632bb" containerName="istio-proxy"
Sep 06 01:33:28.703071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.702991    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:28.703071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.702998    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:28.703071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.703017    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:28.703071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.703026    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aedda1c-de6e-4f3e-86da-675900857982" containerName="istio-proxy"
Sep 06 01:33:28.703361 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.703151    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="453429c4-9f5c-40e0-b192-d09c34398091" containerName="istio-proxy"
Sep 06 01:33:28.706568 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.706544    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.720472 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.720449    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-e805e0-serving-cert\""
Sep 06 01:33:28.723174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.723148    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:33:28.777098 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.777066    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.777281 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.777169    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.777281 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.777221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.878454 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.878417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.878662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.878482    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.878662 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.878532    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.879098 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.879076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.880911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.880890    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:28.885985 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:28.885963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf\") pod \"maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:29.018870 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:29.018779    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:29.304050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:29.304025    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:33:29.306684 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:33:29.306656    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d9ca01_723d_4800_ac40_41f91baf67d3.slice/crio-2dcf44747ed4178ddcd813de5b12b3e0e5ffdc52231f517254732c81928cf4e3 WatchSource:0}: Error finding container 2dcf44747ed4178ddcd813de5b12b3e0e5ffdc52231f517254732c81928cf4e3: Status 404 returned error can't find the container with id 2dcf44747ed4178ddcd813de5b12b3e0e5ffdc52231f517254732c81928cf4e3
Sep 06 01:33:29.538418 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:29.538387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" event={"ID":"52d9ca01-723d-4800-ac40-41f91baf67d3","Type":"ContainerStarted","Data":"2dcf44747ed4178ddcd813de5b12b3e0e5ffdc52231f517254732c81928cf4e3"}
Sep 06 01:33:30.546314 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:30.546277    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" event={"ID":"52d9ca01-723d-4800-ac40-41f91baf67d3","Type":"ContainerStarted","Data":"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"}
Sep 06 01:33:30.546715 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:30.546425    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:30.564200 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:30.564149    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" podStartSLOduration=2.201413815 podStartE2EDuration="2.564135447s" totalImagesPullingTime="362.721632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:33:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:33:30.562678896 +0000 UTC m=+1478.888098872" watchObservedRunningTime="2026-09-06 01:33:30.564135447 +0000 UTC m=+1478.889555479"
Sep 06 01:33:36.557302 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:36.557267    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:46.634463 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.634424    2557 generic.go:356] "Generic (PLEG): container finished" podID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerID="8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee" exitCode=0
Sep 06 01:33:46.634888 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.634503    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerDied","Data":"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"}
Sep 06 01:33:46.634931 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.634917    2557 scope.go:117] "RemoveContainer" containerID="8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"
Sep 06 01:33:46.635991 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.635967    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:46.636047 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.636035    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:46.636085 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:46.636068    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 01:33:47.642290 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:47.642253    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerStarted","Data":"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"}
Sep 06 01:33:48.309475 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:48.309440    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:48.309666 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:48.309641    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:48.309712 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:48.309691    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:49.309767 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:49.309727    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:49.310172 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:49.309785    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:50.309329 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:50.309290    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:50.309503 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:50.309347    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:51.309474 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:51.309429    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:51.309955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:51.309496    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:52.266678 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.266645    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:33:52.272408 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.272381    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:33:52.309571 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.309541    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:52.309907 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.309603    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:52.546297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.546204    2557 scope.go:117] "RemoveContainer" containerID="23fb8d939c9a5ede5e4abb117240da5c4290e6e01ad0c7a1886c6ccba0673cce"
Sep 06 01:33:52.560562 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:52.560453    2557 scope.go:117] "RemoveContainer" containerID="eb1616695a19b3bed31186d6163b9526722bfdb03b23afdcdf7f8ec520d12fb9"
Sep 06 01:33:53.310082 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:53.310042    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 06 01:33:53.310598 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:53.310154    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 06 01:33:54.313366 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:54.313338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:54.313801 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:54.313720    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:54.314403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:54.314386    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:33:59.254188 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.254152    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:33:59.255136 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.255069    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" podUID="52d9ca01-723d-4800-ac40-41f91baf67d3" containerName="maas-api" containerID="cri-o://fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46" gracePeriod=30
Sep 06 01:33:59.512139 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.512065    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:59.564971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.564937    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf\") pod \"52d9ca01-723d-4800-ac40-41f91baf67d3\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") "
Sep 06 01:33:59.565189 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.565003    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls\") pod \"52d9ca01-723d-4800-ac40-41f91baf67d3\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") "
Sep 06 01:33:59.565189 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.565031    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca\") pod \"52d9ca01-723d-4800-ac40-41f91baf67d3\" (UID: \"52d9ca01-723d-4800-ac40-41f91baf67d3\") "
Sep 06 01:33:59.565648 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.565609    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52d9ca01-723d-4800-ac40-41f91baf67d3" (UID: "52d9ca01-723d-4800-ac40-41f91baf67d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:33:59.567248 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.567221    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52d9ca01-723d-4800-ac40-41f91baf67d3" (UID: "52d9ca01-723d-4800-ac40-41f91baf67d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:33:59.567352 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.567277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf" (OuterVolumeSpecName: "kube-api-access-p5lgf") pod "52d9ca01-723d-4800-ac40-41f91baf67d3" (UID: "52d9ca01-723d-4800-ac40-41f91baf67d3"). InnerVolumeSpecName "kube-api-access-p5lgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:33:59.666519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.666484    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5lgf\" (UniqueName: \"kubernetes.io/projected/52d9ca01-723d-4800-ac40-41f91baf67d3-kube-api-access-p5lgf\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.666519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.666515    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52d9ca01-723d-4800-ac40-41f91baf67d3-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.666519 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.666524    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52d9ca01-723d-4800-ac40-41f91baf67d3-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:33:59.716806 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.716774    2557 generic.go:356] "Generic (PLEG): container finished" podID="52d9ca01-723d-4800-ac40-41f91baf67d3" containerID="fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46" exitCode=0
Sep 06 01:33:59.717019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.716832    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"
Sep 06 01:33:59.717019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.716874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" event={"ID":"52d9ca01-723d-4800-ac40-41f91baf67d3","Type":"ContainerDied","Data":"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"}
Sep 06 01:33:59.717019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.716924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr" event={"ID":"52d9ca01-723d-4800-ac40-41f91baf67d3","Type":"ContainerDied","Data":"2dcf44747ed4178ddcd813de5b12b3e0e5ffdc52231f517254732c81928cf4e3"}
Sep 06 01:33:59.717019 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.716945    2557 scope.go:117] "RemoveContainer" containerID="fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"
Sep 06 01:33:59.727385 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.727364    2557 scope.go:117] "RemoveContainer" containerID="fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"
Sep 06 01:33:59.727650 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:33:59.727629    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46\": container with ID starting with fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46 not found: ID does not exist" containerID="fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"
Sep 06 01:33:59.727721 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.727657    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46"} err="failed to get container status \"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46\": rpc error: code = NotFound desc = could not find container \"fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46\": container with ID starting with fe9fc6eb207f1f2de806f72e85f73b7b250377026a8bbea300bc6752a9b0ec46 not found: ID does not exist"
Sep 06 01:33:59.738838 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.738812    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:33:59.742813 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:33:59.742787    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-e805e0-6596b8c55f-n9wtr"]
Sep 06 01:34:00.164041 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:00.164005    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52d9ca01-723d-4800-ac40-41f91baf67d3" path="/var/lib/kubelet/pods/52d9ca01-723d-4800-ac40-41f91baf67d3/volumes"
Sep 06 01:34:05.685455 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:05.685414    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:34:05.685921 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:05.685688    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" containerID="cri-o://c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46" gracePeriod=30
Sep 06 01:34:09.315933 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:09.315897    2557 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 01:34:09.316308 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:09.315957    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 01:34:10.942407 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:10.942379    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:34:11.073157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073080    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073137    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073158    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073184    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073238    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073256    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073417 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073405    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073471    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073507    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbhnw\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw\") pod \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\" (UID: \"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5\") "
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073518    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073532    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073548    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:11.073618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073565    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:34:11.073930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073833    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.073930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073852    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.073930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073864    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.073930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073873    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:11.073930 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.073878    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.075618 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.075593    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw" (OuterVolumeSpecName: "kube-api-access-xbhnw") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "kube-api-access-xbhnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:11.075760 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.075744    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:34:11.075985 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.075962    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:11.075985 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.075975    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" (UID: "9a59ebc3-e7a2-4a9c-992a-0e9923f767a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:34:11.175071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.175040    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.175071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.175065    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.175071 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.175074    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.175310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.175084    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.175310 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.175092    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbhnw\" (UniqueName: \"kubernetes.io/projected/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5-kube-api-access-xbhnw\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:11.781275 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.781239    2557 generic.go:356] "Generic (PLEG): container finished" podID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerID="c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46" exitCode=0
Sep 06 01:34:11.781449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.781289    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"
Sep 06 01:34:11.781449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.781328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerDied","Data":"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"}
Sep 06 01:34:11.781449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.781392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w" event={"ID":"9a59ebc3-e7a2-4a9c-992a-0e9923f767a5","Type":"ContainerDied","Data":"db106ea83a5d5c8a20269889ae6c11615ff6a7d81c4c2b794de9efd645b35a2e"}
Sep 06 01:34:11.781449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.781421    2557 scope.go:117] "RemoveContainer" containerID="c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"
Sep 06 01:34:11.791035 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.791018    2557 scope.go:117] "RemoveContainer" containerID="8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"
Sep 06 01:34:11.798826 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.798808    2557 scope.go:117] "RemoveContainer" containerID="c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"
Sep 06 01:34:11.799092 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:34:11.799073    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46\": container with ID starting with c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46 not found: ID does not exist" containerID="c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"
Sep 06 01:34:11.799277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.799116    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46"} err="failed to get container status \"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46\": rpc error: code = NotFound desc = could not find container \"c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46\": container with ID starting with c8dc750654fa123ae14e5fa509d9dfbc4020e4b599df7ccbe4842c7c93f1ff46 not found: ID does not exist"
Sep 06 01:34:11.799277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.799138    2557 scope.go:117] "RemoveContainer" containerID="8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"
Sep 06 01:34:11.799380 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:34:11.799360    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee\": container with ID starting with 8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee not found: ID does not exist" containerID="8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"
Sep 06 01:34:11.799427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.799386    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee"} err="failed to get container status \"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee\": rpc error: code = NotFound desc = could not find container \"8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee\": container with ID starting with 8744c126b6e4ed40c86ddb8c72267491c6797dd791a8a80e506c948c7ac07bee not found: ID does not exist"
Sep 06 01:34:11.803657 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.803636    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:34:11.809445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:11.809425    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-e805e0-openshift-default-6bcbd7c794-8rr9w"]
Sep 06 01:34:12.163279 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:12.163203    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" path="/var/lib/kubelet/pods/9a59ebc3-e7a2-4a9c-992a-0e9923f767a5/volumes"
Sep 06 01:34:25.000550 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.000462    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:34:25.000955 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.000689    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" podUID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" containerName="maas-api" containerID="cri-o://c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d" gracePeriod=30
Sep 06 01:34:25.257903 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.257834    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:34:25.407582 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.407550    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca\") pod \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") "
Sep 06 01:34:25.407757 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.407627    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") pod \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") "
Sep 06 01:34:25.407757 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.407729    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn76h\" (UniqueName: \"kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h\") pod \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\" (UID: \"b151954e-1f62-4453-8d2f-6ea843e9a8d2\") "
Sep 06 01:34:25.407894 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.407874    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b151954e-1f62-4453-8d2f-6ea843e9a8d2" (UID: "b151954e-1f62-4453-8d2f-6ea843e9a8d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:34:25.408180 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.408163    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b151954e-1f62-4453-8d2f-6ea843e9a8d2-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.409580 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.409555    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h" (OuterVolumeSpecName: "kube-api-access-rn76h") pod "b151954e-1f62-4453-8d2f-6ea843e9a8d2" (UID: "b151954e-1f62-4453-8d2f-6ea843e9a8d2"). InnerVolumeSpecName "kube-api-access-rn76h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:34:25.409685 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.409622    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b151954e-1f62-4453-8d2f-6ea843e9a8d2" (UID: "b151954e-1f62-4453-8d2f-6ea843e9a8d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:34:25.509093 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.509013    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b151954e-1f62-4453-8d2f-6ea843e9a8d2-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.509093 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.509040    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn76h\" (UniqueName: \"kubernetes.io/projected/b151954e-1f62-4453-8d2f-6ea843e9a8d2-kube-api-access-rn76h\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:34:25.856533 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.856441    2557 generic.go:356] "Generic (PLEG): container finished" podID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" containerID="c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d" exitCode=0
Sep 06 01:34:25.856533 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.856492    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"
Sep 06 01:34:25.856769 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.856530    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" event={"ID":"b151954e-1f62-4453-8d2f-6ea843e9a8d2","Type":"ContainerDied","Data":"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"}
Sep 06 01:34:25.856769 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.856599    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk" event={"ID":"b151954e-1f62-4453-8d2f-6ea843e9a8d2","Type":"ContainerDied","Data":"4e31dc316db29a918313ec86e0736a80edc07987c66c92f2fd1474c2389acbd5"}
Sep 06 01:34:25.856769 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.856629    2557 scope.go:117] "RemoveContainer" containerID="c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"
Sep 06 01:34:25.866295 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.866274    2557 scope.go:117] "RemoveContainer" containerID="c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"
Sep 06 01:34:25.866572 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:34:25.866553    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d\": container with ID starting with c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d not found: ID does not exist" containerID="c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"
Sep 06 01:34:25.866647 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.866581    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d"} err="failed to get container status \"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d\": rpc error: code = NotFound desc = could not find container \"c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d\": container with ID starting with c0a59ff47d47ce241de1f80d21b91a6da40a20e1790c96606963145c4d0c913d not found: ID does not exist"
Sep 06 01:34:25.878138 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.878115    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:34:25.881752 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:25.881734    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-de7322-6b5d8887fb-js2mk"]
Sep 06 01:34:26.163667 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:26.163590    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" path="/var/lib/kubelet/pods/b151954e-1f62-4453-8d2f-6ea843e9a8d2/volumes"
Sep 06 01:34:52.592628 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:34:52.592597    2557 scope.go:117] "RemoveContainer" containerID="5c788243acfbf909f475423b88dcb4a541130c31a6ed962bcea75b22b21f9685"
Sep 06 01:35:24.228538 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.228502    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:35:24.229206 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.228947    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" podUID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" containerName="maas-api" containerID="cri-o://49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef" gracePeriod=30
Sep 06 01:35:24.480985 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.480926    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:35:24.538901 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.538870    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") pod \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") "
Sep 06 01:35:24.539065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.538922    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca\") pod \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") "
Sep 06 01:35:24.539065 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.538954    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbr77\" (UniqueName: \"kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77\") pod \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\" (UID: \"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0\") "
Sep 06 01:35:24.539368 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.539339    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" (UID: "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:24.541009 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.540967    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" (UID: "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:35:24.541157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.541028    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77" (OuterVolumeSpecName: "kube-api-access-vbr77") pod "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" (UID: "ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0"). InnerVolumeSpecName "kube-api-access-vbr77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:24.640000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.639967    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:24.640000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.639994    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:24.640000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:24.640005    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbr77\" (UniqueName: \"kubernetes.io/projected/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0-kube-api-access-vbr77\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:25.159891 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.159847    2557 generic.go:356] "Generic (PLEG): container finished" podID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" containerID="49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef" exitCode=0
Sep 06 01:35:25.160096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.159915    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"
Sep 06 01:35:25.160096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.159914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" event={"ID":"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0","Type":"ContainerDied","Data":"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"}
Sep 06 01:35:25.160096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.160032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7" event={"ID":"ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0","Type":"ContainerDied","Data":"f892442d8bbb9a80fd774818c648ad52afcd28aa1d708b4c76f67fe34f8bcbcc"}
Sep 06 01:35:25.160096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.160059    2557 scope.go:117] "RemoveContainer" containerID="49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"
Sep 06 01:35:25.169485 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.169464    2557 scope.go:117] "RemoveContainer" containerID="49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"
Sep 06 01:35:25.169743 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:35:25.169722    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef\": container with ID starting with 49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef not found: ID does not exist" containerID="49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"
Sep 06 01:35:25.169820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.169758    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef"} err="failed to get container status \"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef\": rpc error: code = NotFound desc = could not find container \"49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef\": container with ID starting with 49fe3d06f64d343f2cc2de3bab37376d6bf847ec18bd9d80672da5a6edb490ef not found: ID does not exist"
Sep 06 01:35:25.181453 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.181430    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:35:25.187332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:25.187309    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-0b81e1-5c86fb69cc-q5qr7"]
Sep 06 01:35:26.164701 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:26.164672    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" path="/var/lib/kubelet/pods/ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0/volumes"
Sep 06 01:35:41.587006 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.586965    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:35:41.587504 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.587300    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" podUID="64da895e-044c-4fa9-abb3-a92525f78537" containerName="maas-api" containerID="cri-o://b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb" gracePeriod=30
Sep 06 01:35:41.833522 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.833496    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:35:41.894452 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.894373    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvwfx\" (UniqueName: \"kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx\") pod \"64da895e-044c-4fa9-abb3-a92525f78537\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") "
Sep 06 01:35:41.894622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.894540    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") pod \"64da895e-044c-4fa9-abb3-a92525f78537\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") "
Sep 06 01:35:41.894622 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.894606    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca\") pod \"64da895e-044c-4fa9-abb3-a92525f78537\" (UID: \"64da895e-044c-4fa9-abb3-a92525f78537\") "
Sep 06 01:35:41.894975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.894942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64da895e-044c-4fa9-abb3-a92525f78537" (UID: "64da895e-044c-4fa9-abb3-a92525f78537"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:41.896642 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.896617    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64da895e-044c-4fa9-abb3-a92525f78537" (UID: "64da895e-044c-4fa9-abb3-a92525f78537"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:35:41.896770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.896643    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx" (OuterVolumeSpecName: "kube-api-access-kvwfx") pod "64da895e-044c-4fa9-abb3-a92525f78537" (UID: "64da895e-044c-4fa9-abb3-a92525f78537"). InnerVolumeSpecName "kube-api-access-kvwfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:41.995965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.995933    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64da895e-044c-4fa9-abb3-a92525f78537-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:41.995965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.995960    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64da895e-044c-4fa9-abb3-a92525f78537-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:41.995965 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:41.995972    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvwfx\" (UniqueName: \"kubernetes.io/projected/64da895e-044c-4fa9-abb3-a92525f78537-kube-api-access-kvwfx\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:42.248648 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.248616    2557 generic.go:356] "Generic (PLEG): container finished" podID="64da895e-044c-4fa9-abb3-a92525f78537" containerID="b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb" exitCode=0
Sep 06 01:35:42.248820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.248665    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"
Sep 06 01:35:42.248820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.248710    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" event={"ID":"64da895e-044c-4fa9-abb3-a92525f78537","Type":"ContainerDied","Data":"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"}
Sep 06 01:35:42.248820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.248772    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk" event={"ID":"64da895e-044c-4fa9-abb3-a92525f78537","Type":"ContainerDied","Data":"5eea4b5b716f8ab9e35ef738559f2d4ec55ff61e2afab24c71867dea1be9f29e"}
Sep 06 01:35:42.248820 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.248802    2557 scope.go:117] "RemoveContainer" containerID="b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"
Sep 06 01:35:42.257857 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.257841    2557 scope.go:117] "RemoveContainer" containerID="b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"
Sep 06 01:35:42.258130 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:35:42.258090    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb\": container with ID starting with b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb not found: ID does not exist" containerID="b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"
Sep 06 01:35:42.258130 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.258128    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb"} err="failed to get container status \"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb\": rpc error: code = NotFound desc = could not find container \"b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb\": container with ID starting with b1b3e21b1ff32f9b1350ba5e39f154c55d608191094fa9158bd8c0fad7ce6cbb not found: ID does not exist"
Sep 06 01:35:42.265483 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.265458    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:35:42.271467 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:42.271445    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-5833d5-69db879678-2hdvk"]
Sep 06 01:35:44.163979 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:44.163944    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64da895e-044c-4fa9-abb3-a92525f78537" path="/var/lib/kubelet/pods/64da895e-044c-4fa9-abb3-a92525f78537/volumes"
Sep 06 01:35:48.432490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:48.432454    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:35:48.432920 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:48.432660    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy" containerID="cri-o://e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43" gracePeriod=30
Sep 06 01:35:53.669020 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.668995    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:35:53.802612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802531    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.802612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802568    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2mj5\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.802612 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802591    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802650    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802672    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802701    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802731    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802755    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert\") pod \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\" (UID: \"b7896b18-7623-4ad4-87d4-5af6e5fd0678\") "
Sep 06 01:35:53.803008 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.802904    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:53.803427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.803017    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:53.803427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.803051    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.803427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.803250    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:53.803427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.803330    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:53.803427 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.803409    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:53.804964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.804940    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:35:53.804964 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.804949    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:35:53.805297 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.805277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5" (OuterVolumeSpecName: "kube-api-access-l2mj5") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "kube-api-access-l2mj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:53.805348 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.805295    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7896b18-7623-4ad4-87d4-5af6e5fd0678" (UID: "b7896b18-7623-4ad4-87d4-5af6e5fd0678"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:53.904033 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.903994    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904033 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904030    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904044    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904062    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904074    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7896b18-7623-4ad4-87d4-5af6e5fd0678-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904082    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904091    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2mj5\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-kube-api-access-l2mj5\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:53.904264 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:53.904122    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7896b18-7623-4ad4-87d4-5af6e5fd0678-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:54.312326 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.312289    2557 generic.go:356] "Generic (PLEG): container finished" podID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerID="e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43" exitCode=0
Sep 06 01:35:54.312559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.312358    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"
Sep 06 01:35:54.312559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.312370    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerDied","Data":"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"}
Sep 06 01:35:54.312559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.312437    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px" event={"ID":"b7896b18-7623-4ad4-87d4-5af6e5fd0678","Type":"ContainerDied","Data":"4fc2ffaa2a1bfa8313ec8268ab93f22160c1b6734b20d64b4ccc7f414beafd0c"}
Sep 06 01:35:54.312559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.312466    2557 scope.go:117] "RemoveContainer" containerID="e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"
Sep 06 01:35:54.321611 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.321579    2557 scope.go:117] "RemoveContainer" containerID="d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"
Sep 06 01:35:54.329449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.329430    2557 scope.go:117] "RemoveContainer" containerID="e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"
Sep 06 01:35:54.329716 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:35:54.329696    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43\": container with ID starting with e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43 not found: ID does not exist" containerID="e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"
Sep 06 01:35:54.329786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.329729    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43"} err="failed to get container status \"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43\": rpc error: code = NotFound desc = could not find container \"e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43\": container with ID starting with e3cf72d9b41b72be7e20d0a9937c6a9c024a8ff515007829642f8a422aeaba43 not found: ID does not exist"
Sep 06 01:35:54.329786 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.329753    2557 scope.go:117] "RemoveContainer" containerID="d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"
Sep 06 01:35:54.330073 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:35:54.330051    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c\": container with ID starting with d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c not found: ID does not exist" containerID="d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"
Sep 06 01:35:54.330138 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.330082    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c"} err="failed to get container status \"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c\": rpc error: code = NotFound desc = could not find container \"d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c\": container with ID starting with d14c5c0af993dfb50b8b6ba709f328b460714c301fd2e66b571d50c03efd1d5c not found: ID does not exist"
Sep 06 01:35:54.330929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.330912    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:35:54.337186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:54.337166    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-5833d5-openshift-default-5bbf9487fb-fs2px"]
Sep 06 01:35:56.163732 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:56.163701    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" path="/var/lib/kubelet/pods/b7896b18-7623-4ad4-87d4-5af6e5fd0678/volumes"
Sep 06 01:35:59.179442 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.179404    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:35:59.179878 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.179673    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" podUID="12f5744e-e431-404f-8b7f-7efe8b94507a" containerName="maas-api" containerID="cri-o://56a7c2403f36dd2018da15f9cd4ffd8888f73d7d8e6820740fc82b17e2ff1ae6" gracePeriod=30
Sep 06 01:35:59.339482 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.339453    2557 generic.go:356] "Generic (PLEG): container finished" podID="12f5744e-e431-404f-8b7f-7efe8b94507a" containerID="56a7c2403f36dd2018da15f9cd4ffd8888f73d7d8e6820740fc82b17e2ff1ae6" exitCode=0
Sep 06 01:35:59.339639 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.339521    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" event={"ID":"12f5744e-e431-404f-8b7f-7efe8b94507a","Type":"ContainerDied","Data":"56a7c2403f36dd2018da15f9cd4ffd8888f73d7d8e6820740fc82b17e2ff1ae6"}
Sep 06 01:35:59.419400 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.419376    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:35:59.555361 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.555321    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") pod \"12f5744e-e431-404f-8b7f-7efe8b94507a\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") "
Sep 06 01:35:59.555532 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.555401    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvk88\" (UniqueName: \"kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88\") pod \"12f5744e-e431-404f-8b7f-7efe8b94507a\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") "
Sep 06 01:35:59.555532 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.555480    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca\") pod \"12f5744e-e431-404f-8b7f-7efe8b94507a\" (UID: \"12f5744e-e431-404f-8b7f-7efe8b94507a\") "
Sep 06 01:35:59.555883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.555838    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12f5744e-e431-404f-8b7f-7efe8b94507a" (UID: "12f5744e-e431-404f-8b7f-7efe8b94507a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:35:59.557507 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.557483    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12f5744e-e431-404f-8b7f-7efe8b94507a" (UID: "12f5744e-e431-404f-8b7f-7efe8b94507a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:35:59.557607 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.557551    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88" (OuterVolumeSpecName: "kube-api-access-rvk88") pod "12f5744e-e431-404f-8b7f-7efe8b94507a" (UID: "12f5744e-e431-404f-8b7f-7efe8b94507a"). InnerVolumeSpecName "kube-api-access-rvk88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:35:59.656441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.656410    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12f5744e-e431-404f-8b7f-7efe8b94507a-maas-api-tls\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.656441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.656435    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvk88\" (UniqueName: \"kubernetes.io/projected/12f5744e-e431-404f-8b7f-7efe8b94507a-kube-api-access-rvk88\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:35:59.656441 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:35:59.656445    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12f5744e-e431-404f-8b7f-7efe8b94507a-openshift-service-ca\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:00.346296 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:00.346262    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"
Sep 06 01:36:00.346770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:00.346298    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s" event={"ID":"12f5744e-e431-404f-8b7f-7efe8b94507a","Type":"ContainerDied","Data":"54432dc5dc48d684e7368535c14289d8a29255dcabe0a8a98ec822a8d6eeb516"}
Sep 06 01:36:00.346770 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:00.346366    2557 scope.go:117] "RemoveContainer" containerID="56a7c2403f36dd2018da15f9cd4ffd8888f73d7d8e6820740fc82b17e2ff1ae6"
Sep 06 01:36:00.362231 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:00.362208    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:36:00.366157 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:00.366134    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-41f259-69688ff97d-rpv7s"]
Sep 06 01:36:02.163426 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:02.163391    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12f5744e-e431-404f-8b7f-7efe8b94507a" path="/var/lib/kubelet/pods/12f5744e-e431-404f-8b7f-7efe8b94507a/volumes"
Sep 06 01:36:05.810778 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:05.810737    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:36:05.811241 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:05.811049    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy" containerID="cri-o://39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d" gracePeriod=30
Sep 06 01:36:08.693351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:08.693317    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:36:08.693775 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:08.693500    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" podUID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" containerName="manager" containerID="cri-o://d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca" gracePeriod=30
Sep 06 01:36:08.941880 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:08.941856    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:36:09.039042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.038966    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdhd8\" (UniqueName: \"kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8\") pod \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") "
Sep 06 01:36:09.039042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.039012    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs\") pod \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") "
Sep 06 01:36:09.039042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.039043    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert\") pod \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\" (UID: \"04a64905-add5-490e-b5a8-1b2a5e91eaa4\") "
Sep 06 01:36:09.041272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.041236    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04a64905-add5-490e-b5a8-1b2a5e91eaa4" (UID: "04a64905-add5-490e-b5a8-1b2a5e91eaa4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:36:09.041272 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.041253    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "04a64905-add5-490e-b5a8-1b2a5e91eaa4" (UID: "04a64905-add5-490e-b5a8-1b2a5e91eaa4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:36:09.041465 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.041360    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8" (OuterVolumeSpecName: "kube-api-access-cdhd8") pod "04a64905-add5-490e-b5a8-1b2a5e91eaa4" (UID: "04a64905-add5-490e-b5a8-1b2a5e91eaa4"). InnerVolumeSpecName "kube-api-access-cdhd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:36:09.140050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.140024    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-webhook-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:09.140050 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.140048    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdhd8\" (UniqueName: \"kubernetes.io/projected/04a64905-add5-490e-b5a8-1b2a5e91eaa4-kube-api-access-cdhd8\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:09.140306 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.140060    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04a64905-add5-490e-b5a8-1b2a5e91eaa4-metrics-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:09.393559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.393468    2557 generic.go:356] "Generic (PLEG): container finished" podID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" containerID="d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca" exitCode=0
Sep 06 01:36:09.393559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.393511    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb"
Sep 06 01:36:09.393739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.393559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" event={"ID":"04a64905-add5-490e-b5a8-1b2a5e91eaa4","Type":"ContainerDied","Data":"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"}
Sep 06 01:36:09.393739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.393608    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-f94tb" event={"ID":"04a64905-add5-490e-b5a8-1b2a5e91eaa4","Type":"ContainerDied","Data":"0e2ebde19c122ecc978785b9bbd71f41ecda812f1a1b2f7cd6ad1394f583e4e2"}
Sep 06 01:36:09.393739 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.393632    2557 scope.go:117] "RemoveContainer" containerID="d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"
Sep 06 01:36:09.402988 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.402965    2557 scope.go:117] "RemoveContainer" containerID="d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"
Sep 06 01:36:09.403262 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:36:09.403242    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca\": container with ID starting with d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca not found: ID does not exist" containerID="d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"
Sep 06 01:36:09.403388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.403273    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca"} err="failed to get container status \"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca\": rpc error: code = NotFound desc = could not find container \"d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca\": container with ID starting with d47d8d0177af2d6bea1460c9a7914a428c1674e9ef374ae3383e685b5eec94ca not found: ID does not exist"
Sep 06 01:36:09.414652 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.414631    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:36:09.418389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:09.418370    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-f94tb"]
Sep 06 01:36:10.163403 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:10.163370    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" path="/var/lib/kubelet/pods/04a64905-add5-490e-b5a8-1b2a5e91eaa4/volumes"
Sep 06 01:36:11.064576 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.064551    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:36:11.156574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156493    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156541    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156574 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156562    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156580    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156616    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156663    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156693    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156764    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:36:11.156851 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156840    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:36:11.157161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156862    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h6xd\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.157161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156921    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo\") pod \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\" (UID: \"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8\") "
Sep 06 01:36:11.157161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.156943    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:36:11.157161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157035    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:36:11.157161 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157053    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 01:36:11.157415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157348    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-data\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.157415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157363    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.157415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157373    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istiod-ca-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.157415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157387    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-credential-socket\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.157415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.157399    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-workload-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.159032 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.159007    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:36:11.159186 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.159008    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd" (OuterVolumeSpecName: "kube-api-access-5h6xd") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "kube-api-access-5h6xd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:36:11.159348 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.159329    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 01:36:11.159422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.159328    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" (UID: "24c69fbb-5c8c-4baa-8825-2a6ab6f949c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:36:11.258055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.258027    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-token\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.258055 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.258055    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-envoy\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.258380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.258071    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h6xd\" (UniqueName: \"kubernetes.io/projected/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-kube-api-access-5h6xd\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.258380 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.258084    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8-istio-podinfo\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:36:11.404883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.404850    2557 generic.go:356] "Generic (PLEG): container finished" podID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerID="39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d" exitCode=0
Sep 06 01:36:11.405029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.404915    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"
Sep 06 01:36:11.405029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.404936    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerDied","Data":"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"}
Sep 06 01:36:11.405029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.404992    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592" event={"ID":"24c69fbb-5c8c-4baa-8825-2a6ab6f949c8","Type":"ContainerDied","Data":"d39c32d7e0077ddb15aca87877318563486ee37d1c52b0b9e69b33a4dfa84556"}
Sep 06 01:36:11.405029 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.405017    2557 scope.go:117] "RemoveContainer" containerID="39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"
Sep 06 01:36:11.413741 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.413723    2557 scope.go:117] "RemoveContainer" containerID="4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"
Sep 06 01:36:11.420997 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.420982    2557 scope.go:117] "RemoveContainer" containerID="39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"
Sep 06 01:36:11.421271 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:36:11.421254    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d\": container with ID starting with 39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d not found: ID does not exist" containerID="39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"
Sep 06 01:36:11.421324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.421279    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d"} err="failed to get container status \"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d\": rpc error: code = NotFound desc = could not find container \"39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d\": container with ID starting with 39bae8545ac8f9c541796c0262827f6709b535f24f2d84d6da9f3ea75f70bd3d not found: ID does not exist"
Sep 06 01:36:11.421324 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.421299    2557 scope.go:117] "RemoveContainer" containerID="4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"
Sep 06 01:36:11.421542 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:36:11.421526    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb\": container with ID starting with 4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb not found: ID does not exist" containerID="4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"
Sep 06 01:36:11.421591 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.421544    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb"} err="failed to get container status \"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb\": rpc error: code = NotFound desc = could not find container \"4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb\": container with ID starting with 4c4e0a8cfe01b58a1236e061b2cfb04908f5ac7978e99a2c404c7c881d7329eb not found: ID does not exist"
Sep 06 01:36:11.426973 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.426952    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:36:11.430540 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:11.430520    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-41f259-openshift-default-689f7c7d96-sn592"]
Sep 06 01:36:12.165159 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:12.165126    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" path="/var/lib/kubelet/pods/24c69fbb-5c8c-4baa-8825-2a6ab6f949c8/volumes"
Sep 06 01:36:52.641653 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:36:52.641621    2557 scope.go:117] "RemoveContainer" containerID="d62d9a6b19c9aace1f15da036494f409b57f48f4f5e67f6cf22fad62d3731e18"
Sep 06 01:37:10.270865 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.270823    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271351    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" containerName="manager"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271372    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" containerName="manager"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271383    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271393    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271409    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271418    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271428    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271436    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271456    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" containerName="maas-api"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271464    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" containerName="maas-api"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271483    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64da895e-044c-4fa9-abb3-a92525f78537" containerName="maas-api"
Sep 06 01:37:10.271490 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271492    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="64da895e-044c-4fa9-abb3-a92525f78537" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271502    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12f5744e-e431-404f-8b7f-7efe8b94507a" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271510    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="12f5744e-e431-404f-8b7f-7efe8b94507a" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271521    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271530    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271541    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271549    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271558    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271567    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271584    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52d9ca01-723d-4800-ac40-41f91baf67d3" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271592    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="52d9ca01-723d-4800-ac40-41f91baf67d3" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271698    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271710    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271719    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="12f5744e-e431-404f-8b7f-7efe8b94507a" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271730    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae68df3c-08e1-4b7d-a1a4-e1b5f47cd1b0" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271740    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="52d9ca01-723d-4800-ac40-41f91baf67d3" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271749    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a64905-add5-490e-b5a8-1b2a5e91eaa4" containerName="manager"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271758    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7896b18-7623-4ad4-87d4-5af6e5fd0678" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271767    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271775    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271783    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="64da895e-044c-4fa9-abb3-a92525f78537" containerName="maas-api"
Sep 06 01:37:10.272124 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.271792    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b151954e-1f62-4453-8d2f-6ea843e9a8d2" containerName="maas-api"
Sep 06 01:37:10.275042 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.275021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.277616 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.277597    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:37:10.278632 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.278616    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:37:10.278742 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.278616    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:37:10.278742 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.278699    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f8grl\""
Sep 06 01:37:10.286238 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.286209    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:10.350939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.350903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.351083 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.350955    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.351083 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.351029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nns5x\" (UniqueName: \"kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.451836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.451804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.451971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.451849    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.451971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.451875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nns5x\" (UniqueName: \"kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.454401 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.454377    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.454532 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.454429    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.459724 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.459706    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nns5x\" (UniqueName: \"kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x\") pod \"maas-controller-6d8ddb49f9-ghb2j\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") " pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.587355 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.587280    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:10.858735 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.858682    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:10.861070 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:37:10.861044    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c55751_053e_496b_b62f_b746ab0e4860.slice/crio-5bafa0b31b4282f48c11c8c176a6a323642afc5f47876537cb72aa17339dc71c WatchSource:0}: Error finding container 5bafa0b31b4282f48c11c8c176a6a323642afc5f47876537cb72aa17339dc71c: Status 404 returned error can't find the container with id 5bafa0b31b4282f48c11c8c176a6a323642afc5f47876537cb72aa17339dc71c
Sep 06 01:37:10.862373 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:10.862356    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:37:11.696223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:11.696192    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" event={"ID":"93c55751-053e-496b-b62f-b746ab0e4860","Type":"ContainerStarted","Data":"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"}
Sep 06 01:37:11.696546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:11.696250    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" event={"ID":"93c55751-053e-496b-b62f-b746ab0e4860","Type":"ContainerStarted","Data":"5bafa0b31b4282f48c11c8c176a6a323642afc5f47876537cb72aa17339dc71c"}
Sep 06 01:37:11.696546 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:11.696309    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:11.713916 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:11.713866    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" podStartSLOduration=0.962403529 podStartE2EDuration="1.713849015s" totalImagesPullingTime="751.445486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:37:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:37:11.712727168 +0000 UTC m=+1700.038147146" watchObservedRunningTime="2026-09-06 01:37:11.713849015 +0000 UTC m=+1700.039268992"
Sep 06 01:37:22.703096 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:22.703014    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:32.104644 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.104601    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:32.105143 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.104907    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" podUID="93c55751-053e-496b-b62f-b746ab0e4860" containerName="manager" containerID="cri-o://cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f" gracePeriod=30
Sep 06 01:37:32.353478 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.353452    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:32.447590 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.447556    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert\") pod \"93c55751-053e-496b-b62f-b746ab0e4860\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") "
Sep 06 01:37:32.447782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.447663    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nns5x\" (UniqueName: \"kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x\") pod \"93c55751-053e-496b-b62f-b746ab0e4860\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") "
Sep 06 01:37:32.447782 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.447732    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs\") pod \"93c55751-053e-496b-b62f-b746ab0e4860\" (UID: \"93c55751-053e-496b-b62f-b746ab0e4860\") "
Sep 06 01:37:32.449696 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.449663    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93c55751-053e-496b-b62f-b746ab0e4860" (UID: "93c55751-053e-496b-b62f-b746ab0e4860"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:37:32.449840 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.449672    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "93c55751-053e-496b-b62f-b746ab0e4860" (UID: "93c55751-053e-496b-b62f-b746ab0e4860"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 01:37:32.449977 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.449959    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x" (OuterVolumeSpecName: "kube-api-access-nns5x") pod "93c55751-053e-496b-b62f-b746ab0e4860" (UID: "93c55751-053e-496b-b62f-b746ab0e4860"). InnerVolumeSpecName "kube-api-access-nns5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:37:32.549223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.549191    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nns5x\" (UniqueName: \"kubernetes.io/projected/93c55751-053e-496b-b62f-b746ab0e4860-kube-api-access-nns5x\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:37:32.549223 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.549220    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-metrics-certs\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:37:32.549395 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.549232    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93c55751-053e-496b-b62f-b746ab0e4860-webhook-cert\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:37:32.799494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.799403    2557 generic.go:356] "Generic (PLEG): container finished" podID="93c55751-053e-496b-b62f-b746ab0e4860" containerID="cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f" exitCode=0
Sep 06 01:37:32.799494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.799447    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j"
Sep 06 01:37:32.799494 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.799479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" event={"ID":"93c55751-053e-496b-b62f-b746ab0e4860","Type":"ContainerDied","Data":"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"}
Sep 06 01:37:32.799727 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.799523    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-ghb2j" event={"ID":"93c55751-053e-496b-b62f-b746ab0e4860","Type":"ContainerDied","Data":"5bafa0b31b4282f48c11c8c176a6a323642afc5f47876537cb72aa17339dc71c"}
Sep 06 01:37:32.799727 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.799544    2557 scope.go:117] "RemoveContainer" containerID="cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"
Sep 06 01:37:32.808682 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.808666    2557 scope.go:117] "RemoveContainer" containerID="cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"
Sep 06 01:37:32.808926 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:37:32.808907    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f\": container with ID starting with cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f not found: ID does not exist" containerID="cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"
Sep 06 01:37:32.808978 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.808935    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f"} err="failed to get container status \"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f\": rpc error: code = NotFound desc = could not find container \"cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f\": container with ID starting with cfef0915d542cf59ad86f85954528884ad076d36af0b896c428d6c6c2cf0a07f not found: ID does not exist"
Sep 06 01:37:32.821463 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.821441    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:32.827781 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:32.827759    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-ghb2j"]
Sep 06 01:37:33.636543 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636513    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-7qpcf"]
Sep 06 01:37:33.636896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636869    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:33.636896 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636882    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c69fbb-5c8c-4baa-8825-2a6ab6f949c8" containerName="istio-proxy"
Sep 06 01:37:33.636972 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636902    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c55751-053e-496b-b62f-b746ab0e4860" containerName="manager"
Sep 06 01:37:33.636972 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636909    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c55751-053e-496b-b62f-b746ab0e4860" containerName="manager"
Sep 06 01:37:33.637037 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636973    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c55751-053e-496b-b62f-b746ab0e4860" containerName="manager"
Sep 06 01:37:33.637037 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.636987    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a59ebc3-e7a2-4a9c-992a-0e9923f767a5" containerName="istio-proxy"
Sep 06 01:37:33.641415 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.641392    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.645242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.645218    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 06 01:37:33.645242 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.645231    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f8grl\""
Sep 06 01:37:33.645448 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.645255    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 06 01:37:33.645448 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.645231    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 06 01:37:33.648899 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.648877    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-7qpcf"]
Sep 06 01:37:33.757925 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.757891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-webhook-cert\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.758138 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.757978    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-metrics-certs\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.758138 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.757997    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkrpr\" (UniqueName: \"kubernetes.io/projected/624bd961-3f05-4053-8189-ef30efd3ee5b-kube-api-access-fkrpr\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.858908 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.858871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-webhook-cert\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.859075 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.858967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-metrics-certs\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.859075 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.858986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkrpr\" (UniqueName: \"kubernetes.io/projected/624bd961-3f05-4053-8189-ef30efd3ee5b-kube-api-access-fkrpr\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.861316 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.861287    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-webhook-cert\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.861429 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.861392    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/624bd961-3f05-4053-8189-ef30efd3ee5b-metrics-certs\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.867694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.867669    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkrpr\" (UniqueName: \"kubernetes.io/projected/624bd961-3f05-4053-8189-ef30efd3ee5b-kube-api-access-fkrpr\") pod \"maas-controller-6d8ddb49f9-7qpcf\" (UID: \"624bd961-3f05-4053-8189-ef30efd3ee5b\") " pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:33.954717 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:33.954687    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:34.163699 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.163664    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c55751-053e-496b-b62f-b746ab0e4860" path="/var/lib/kubelet/pods/93c55751-053e-496b-b62f-b746ab0e4860/volumes"
Sep 06 01:37:34.225213 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.225190    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d8ddb49f9-7qpcf"]
Sep 06 01:37:34.227359 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:37:34.227317    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624bd961_3f05_4053_8189_ef30efd3ee5b.slice/crio-a514b1ecc8a047098577d2f31b58582df29e6fea9827b366955fe87906bf681f WatchSource:0}: Error finding container a514b1ecc8a047098577d2f31b58582df29e6fea9827b366955fe87906bf681f: Status 404 returned error can't find the container with id a514b1ecc8a047098577d2f31b58582df29e6fea9827b366955fe87906bf681f
Sep 06 01:37:34.812073 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.812027    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf" event={"ID":"624bd961-3f05-4053-8189-ef30efd3ee5b","Type":"ContainerStarted","Data":"e5bf1c4e836592edb447f7f7e31d23d7baa0e1c2215c0450ccfc990dd4758d2f"}
Sep 06 01:37:34.812456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.812091    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf" event={"ID":"624bd961-3f05-4053-8189-ef30efd3ee5b","Type":"ContainerStarted","Data":"a514b1ecc8a047098577d2f31b58582df29e6fea9827b366955fe87906bf681f"}
Sep 06 01:37:34.812456 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.812140    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:34.831498 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:34.831442    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf" podStartSLOduration=1.35819652 podStartE2EDuration="1.831423989s" totalImagesPullingTime="473.227469ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:37:34.828328057 +0000 UTC m=+1723.153748034" watchObservedRunningTime="2026-09-06 01:37:34.831423989 +0000 UTC m=+1723.156843967"
Sep 06 01:37:45.819051 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:45.819019    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d8ddb49f9-7qpcf"
Sep 06 01:37:52.673362 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:37:52.673325    2557 scope.go:117] "RemoveContainer" containerID="99182d35842077e3d63324a1aa621f080b79b9789619be1c58dc70af2ebf0423"
Sep 06 01:38:41.415052 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.415010    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:38:41.415584 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.415252    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" podUID="f532a803-2cac-4209-939d-17d549810a7f" containerName="manager" containerID="cri-o://445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0" gracePeriod=10
Sep 06 01:38:41.666694 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.666625    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:38:41.741119 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.741071    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume\") pod \"f532a803-2cac-4209-939d-17d549810a7f\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") "
Sep 06 01:38:41.741305 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.741146    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8b7g\" (UniqueName: \"kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g\") pod \"f532a803-2cac-4209-939d-17d549810a7f\" (UID: \"f532a803-2cac-4209-939d-17d549810a7f\") "
Sep 06 01:38:41.741457 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.741431    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f532a803-2cac-4209-939d-17d549810a7f" (UID: "f532a803-2cac-4209-939d-17d549810a7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 01:38:41.743154 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.743124    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g" (OuterVolumeSpecName: "kube-api-access-t8b7g") pod "f532a803-2cac-4209-939d-17d549810a7f" (UID: "f532a803-2cac-4209-939d-17d549810a7f"). InnerVolumeSpecName "kube-api-access-t8b7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 01:38:41.841677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.841632    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f532a803-2cac-4209-939d-17d549810a7f-extensions-socket-volume\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:38:41.841677 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:41.841670    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8b7g\" (UniqueName: \"kubernetes.io/projected/f532a803-2cac-4209-939d-17d549810a7f-kube-api-access-t8b7g\") on node \"ip-10-0-132-189.ec2.internal\" DevicePath \"\""
Sep 06 01:38:42.132422 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.132383    2557 generic.go:356] "Generic (PLEG): container finished" podID="f532a803-2cac-4209-939d-17d549810a7f" containerID="445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0" exitCode=0
Sep 06 01:38:42.132594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.132432    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"
Sep 06 01:38:42.132594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.132432    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" event={"ID":"f532a803-2cac-4209-939d-17d549810a7f","Type":"ContainerDied","Data":"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"}
Sep 06 01:38:42.132594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.132542    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw" event={"ID":"f532a803-2cac-4209-939d-17d549810a7f","Type":"ContainerDied","Data":"11eb65eeb88e6a5d6392e4c078beb0150ba57440b7edab86b57b576c71be10d5"}
Sep 06 01:38:42.132594 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.132572    2557 scope.go:117] "RemoveContainer" containerID="445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"
Sep 06 01:38:42.142174 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.142151    2557 scope.go:117] "RemoveContainer" containerID="445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"
Sep 06 01:38:42.142447 ip-10-0-132-189 kubenswrapper[2557]: E0906 01:38:42.142427    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0\": container with ID starting with 445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0 not found: ID does not exist" containerID="445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"
Sep 06 01:38:42.142517 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.142455    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0"} err="failed to get container status \"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0\": rpc error: code = NotFound desc = could not find container \"445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0\": container with ID starting with 445646d0781537aaa4901a6f070df152b959071ae5f8aad99d0e6126fa3a98c0 not found: ID does not exist"
Sep 06 01:38:42.154613 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.154584    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:38:42.162641 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:42.162616    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-g2jlw"]
Sep 06 01:38:44.162285 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:44.162247    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f532a803-2cac-4209-939d-17d549810a7f" path="/var/lib/kubelet/pods/f532a803-2cac-4209-939d-17d549810a7f/volumes"
Sep 06 01:38:52.296250 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:52.296221    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:38:52.306014 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:38:52.305990    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:39:42.167926 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.167889    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"]
Sep 06 01:39:42.168434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.168283    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f532a803-2cac-4209-939d-17d549810a7f" containerName="manager"
Sep 06 01:39:42.168434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.168294    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f532a803-2cac-4209-939d-17d549810a7f" containerName="manager"
Sep 06 01:39:42.168434 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.168349    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f532a803-2cac-4209-939d-17d549810a7f" containerName="manager"
Sep 06 01:39:42.171212 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.171196    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.173619 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.173594    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6fnp5\""
Sep 06 01:39:42.181340 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.181315    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"]
Sep 06 01:39:42.352975 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.352927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.353235 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.352982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7777h\" (UniqueName: \"kubernetes.io/projected/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-kube-api-access-7777h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.454866 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.454827    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.455049 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.454871    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7777h\" (UniqueName: \"kubernetes.io/projected/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-kube-api-access-7777h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.455265 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.455243    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.464175 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.464150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7777h\" (UniqueName: \"kubernetes.io/projected/82a51ed7-1102-4504-9bf8-2ed32de1f8c3-kube-api-access-7777h\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-l4sdx\" (UID: \"82a51ed7-1102-4504-9bf8-2ed32de1f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.482671 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.482639    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:42.776929 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:42.776904    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"]
Sep 06 01:39:42.778987 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:39:42.778953    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a51ed7_1102_4504_9bf8_2ed32de1f8c3.slice/crio-45a0ca352abf64ab365a113d5f7afd2686b9f7ca2abb296f3e0b4f8ac5db429a WatchSource:0}: Error finding container 45a0ca352abf64ab365a113d5f7afd2686b9f7ca2abb296f3e0b4f8ac5db429a: Status 404 returned error can't find the container with id 45a0ca352abf64ab365a113d5f7afd2686b9f7ca2abb296f3e0b4f8ac5db429a
Sep 06 01:39:43.419856 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:43.419820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx" event={"ID":"82a51ed7-1102-4504-9bf8-2ed32de1f8c3","Type":"ContainerStarted","Data":"0d76fa08f22996d6812ae29adf8f80033eac255fc56f0c47c295ed8b6346cd9a"}
Sep 06 01:39:43.420309 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:43.419874    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx" event={"ID":"82a51ed7-1102-4504-9bf8-2ed32de1f8c3","Type":"ContainerStarted","Data":"45a0ca352abf64ab365a113d5f7afd2686b9f7ca2abb296f3e0b4f8ac5db429a"}
Sep 06 01:39:43.420309 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:43.419965    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:39:43.443425 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:43.443371    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx" podStartSLOduration=1.443356365 podStartE2EDuration="1.443356365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:39:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:39:43.442239044 +0000 UTC m=+1851.767659033" watchObservedRunningTime="2026-09-06 01:39:43.443356365 +0000 UTC m=+1851.768776342"
Sep 06 01:39:54.427098 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:39:54.427063    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-l4sdx"
Sep 06 01:43:52.327559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:43:52.327529    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:43:52.335764 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:43:52.335742    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:44:35.920400 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:35.920370    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b75fb4cd-9gc2k_5cd795d7-7a06-4dc2-84dc-b917d30c5f16/authorino/0.log"
Sep 06 01:44:41.381183 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:41.381150    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7v55k_5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d/manager/0.log"
Sep 06 01:44:41.642221 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:41.642148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d8ddb49f9-7qpcf_624bd961-3f05-4053-8189-ef30efd3ee5b/manager/0.log"
Sep 06 01:44:41.756317 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:41.756291    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ssf42_dfbfddf0-54eb-4c1d-87fc-2363746d7185/server/0.log"
Sep 06 01:44:42.006884 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:42.006855    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-t9ck5_927f0119-f6f4-4102-a28f-f0d2ad79f5b7/copy-manifests/0.log"
Sep 06 01:44:42.012559 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:42.012538    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-t9ck5_927f0119-f6f4-4102-a28f-f0d2ad79f5b7/manager/0.log"
Sep 06 01:44:42.602270 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:42.602242    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-b7787bf5-2t6bg_1032924f-06fc-45c3-8ec4-4becab0c607f/maas-api/0.log"
Sep 06 01:44:42.831768 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:42.831741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-sxd2c_6d043bbc-dc86-4343-a70b-dbde4a684bee/postgres/0.log"
Sep 06 01:44:43.637341 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:43.637308    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b75fb4cd-9gc2k_5cd795d7-7a06-4dc2-84dc-b917d30c5f16/authorino/0.log"
Sep 06 01:44:43.753037 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:43.753009    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-7zpl2_89fd4277-6a43-4673-9511-a192aa67cb1a/manager/0.log"
Sep 06 01:44:43.866230 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:43.866202    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-mnjs2_a47d1c05-50f0-441f-a042-5aba6b4655b8/manager/0.log"
Sep 06 01:44:43.979773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:43.979743    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-56z98_e908fc12-b41e-434d-b0d6-535c190d6d58/kuadrant-console-plugin/0.log"
Sep 06 01:44:44.107176 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:44.107148    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-l4sdx_82a51ed7-1102-4504-9bf8-2ed32de1f8c3/manager/0.log"
Sep 06 01:44:44.340835 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:44.340731    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-vtp5m_5b1e24b9-e5b0-473f-9ef3-542c40e16b79/manager/0.log"
Sep 06 01:44:44.931958 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:44.931933    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-qdqkj_7718d843-9942-4be0-99f8-544b0fb4f4bb/kube-auth-proxy/0.log"
Sep 06 01:44:45.287773 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:45.287745    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8n29j_b1ae75ab-d8f3-493b-92a4-c47e94955f41/payload-pre-processing/0.log"
Sep 06 01:44:45.522396 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:45.522368    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f886f478-psnfb_dba8747c-e652-4685-804a-276d52281982/router/0.log"
Sep 06 01:44:52.358825 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.358791    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44kv5/must-gather-xhqc2"]
Sep 06 01:44:52.362449 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.362420    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.365150 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.365134    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-44kv5\"/\"default-dockercfg-kn5hd\""
Sep 06 01:44:52.365263 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.365175    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"openshift-service-ca.crt\""
Sep 06 01:44:52.366000 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.365978    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-44kv5\"/\"kube-root-ca.crt\""
Sep 06 01:44:52.434277 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.434241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/must-gather-xhqc2"]
Sep 06 01:44:52.441758 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.441731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55689c02-71a2-41c5-a70d-f6c317c64095-must-gather-output\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.441855 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.441776    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mtl\" (UniqueName: \"kubernetes.io/projected/55689c02-71a2-41c5-a70d-f6c317c64095-kube-api-access-65mtl\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.542329 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.542287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mtl\" (UniqueName: \"kubernetes.io/projected/55689c02-71a2-41c5-a70d-f6c317c64095-kube-api-access-65mtl\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.542498 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.542391    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55689c02-71a2-41c5-a70d-f6c317c64095-must-gather-output\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.542717 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.542700    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/55689c02-71a2-41c5-a70d-f6c317c64095-must-gather-output\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.563389 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.563358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mtl\" (UniqueName: \"kubernetes.io/projected/55689c02-71a2-41c5-a70d-f6c317c64095-kube-api-access-65mtl\") pod \"must-gather-xhqc2\" (UID: \"55689c02-71a2-41c5-a70d-f6c317c64095\") " pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.671690 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.671612    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/must-gather-xhqc2"
Sep 06 01:44:52.954066 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.954039    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/must-gather-xhqc2"]
Sep 06 01:44:52.956520 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:44:52.956493    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55689c02_71a2_41c5_a70d_f6c317c64095.slice/crio-611bece40d3010d00599e2600322c26736aac10adf8c0c6330055474cc08a7d0 WatchSource:0}: Error finding container 611bece40d3010d00599e2600322c26736aac10adf8c0c6330055474cc08a7d0: Status 404 returned error can't find the container with id 611bece40d3010d00599e2600322c26736aac10adf8c0c6330055474cc08a7d0
Sep 06 01:44:52.958428 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:52.958407    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 01:44:53.878745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:53.878655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/must-gather-xhqc2" event={"ID":"55689c02-71a2-41c5-a70d-f6c317c64095","Type":"ContainerStarted","Data":"a966ccd318764e013696c99e5034e79025e7de4100ca12b06064640cf3d009b2"}
Sep 06 01:44:53.878745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:53.878697    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/must-gather-xhqc2" event={"ID":"55689c02-71a2-41c5-a70d-f6c317c64095","Type":"ContainerStarted","Data":"2c0dfdcf2be2c7e24589c992982b3e0ae707cb6720ed5b442ee8eb4c231ed252"}
Sep 06 01:44:53.878745 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:53.878711    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/must-gather-xhqc2" event={"ID":"55689c02-71a2-41c5-a70d-f6c317c64095","Type":"ContainerStarted","Data":"611bece40d3010d00599e2600322c26736aac10adf8c0c6330055474cc08a7d0"}
Sep 06 01:44:53.900016 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:53.899962    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44kv5/must-gather-xhqc2" podStartSLOduration=1.237459679 podStartE2EDuration="1.899946817s" totalImagesPullingTime="662.487138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 01:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:44:53.898160152 +0000 UTC m=+2162.223580151" watchObservedRunningTime="2026-09-06 01:44:53.899946817 +0000 UTC m=+2162.225366793"
Sep 06 01:44:55.371332 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:55.371305    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cxwgr_92a27631-0fbb-4f7f-8c9f-04a5fbcb2883/global-pull-secret-syncer/0.log"
Sep 06 01:44:55.616949 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:55.616921    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v8dvq_f9e677ae-0f91-4874-9b42-24335811139d/konnectivity-agent/0.log"
Sep 06 01:44:55.671201 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:44:55.671094    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-189.ec2.internal_8a70fe34e4a8c25c4ae59d68c20a213c/haproxy/0.log"
Sep 06 01:45:00.275131 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.272032    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-65b75fb4cd-9gc2k_5cd795d7-7a06-4dc2-84dc-b917d30c5f16/authorino/0.log"
Sep 06 01:45:00.328513 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.328334    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-7zpl2_89fd4277-6a43-4673-9511-a192aa67cb1a/manager/0.log"
Sep 06 01:45:00.386436 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.386404    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-mnjs2_a47d1c05-50f0-441f-a042-5aba6b4655b8/manager/0.log"
Sep 06 01:45:00.425950 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.425923    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-56z98_e908fc12-b41e-434d-b0d6-535c190d6d58/kuadrant-console-plugin/0.log"
Sep 06 01:45:00.507445 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.507383    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-l4sdx_82a51ed7-1102-4504-9bf8-2ed32de1f8c3/manager/0.log"
Sep 06 01:45:00.615836 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:00.615580    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-vtp5m_5b1e24b9-e5b0-473f-9ef3-542c40e16b79/manager/0.log"
Sep 06 01:45:02.540320 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:02.539072    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-nzvhs_188873e6-b47d-4de0-8130-23dead3b720d/cluster-monitoring-operator/0.log"
Sep 06 01:45:02.895895 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:02.895865    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwlwn_bb628175-10e7-4be0-b1d4-3e959ddbae95/node-exporter/0.log"
Sep 06 01:45:02.937388 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:02.937359    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwlwn_bb628175-10e7-4be0-b1d4-3e959ddbae95/kube-rbac-proxy/0.log"
Sep 06 01:45:02.971892 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:02.971859    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rwlwn_bb628175-10e7-4be0-b1d4-3e959ddbae95/init-textfile/0.log"
Sep 06 01:45:05.079605 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.079561    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"]
Sep 06 01:45:05.086011 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.085984    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.090723 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.090692    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"]
Sep 06 01:45:05.180590 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.180538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-sys\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.180881 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.180849    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-proc\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.181131 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.181092    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7bv8\" (UniqueName: \"kubernetes.io/projected/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-kube-api-access-p7bv8\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.181345 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.181329    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-lib-modules\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.181481 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.181465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-podres\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-lib-modules\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282610 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-podres\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282649    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-sys\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282671    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-proc\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-podres\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282780    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-sys\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7bv8\" (UniqueName: \"kubernetes.io/projected/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-kube-api-access-p7bv8\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-proc\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.282883 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.282766    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-lib-modules\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.300741 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.300686    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7bv8\" (UniqueName: \"kubernetes.io/projected/f6a521e3-1d73-4bf8-bebb-99577a4ae64a-kube-api-access-p7bv8\") pod \"perf-node-gather-daemonset-8kkfc\" (UID: \"f6a521e3-1d73-4bf8-bebb-99577a4ae64a\") " pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.407182 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.406869    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.651649 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.651624    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/1.log"
Sep 06 01:45:05.660526 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.660413    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-qvj9n_aa511636-24ee-41a0-b205-3e30836edf53/console-operator/2.log"
Sep 06 01:45:05.716329 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.716288    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"]
Sep 06 01:45:05.724192 ip-10-0-132-189 kubenswrapper[2557]: W0906 01:45:05.722520    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6a521e3_1d73_4bf8_bebb_99577a4ae64a.slice/crio-71d9d0ac9660c5d9566e5ab5e631d200c9c4386846056f44f7f8fe5d6251c972 WatchSource:0}: Error finding container 71d9d0ac9660c5d9566e5ab5e631d200c9c4386846056f44f7f8fe5d6251c972: Status 404 returned error can't find the container with id 71d9d0ac9660c5d9566e5ab5e631d200c9c4386846056f44f7f8fe5d6251c972
Sep 06 01:45:05.964421 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.964367    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc" event={"ID":"f6a521e3-1d73-4bf8-bebb-99577a4ae64a","Type":"ContainerStarted","Data":"fca79de793149364d47948ab36567b40d3968ead062ac9edabb2954a25dc5678"}
Sep 06 01:45:05.964660 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.964434    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc" event={"ID":"f6a521e3-1d73-4bf8-bebb-99577a4ae64a","Type":"ContainerStarted","Data":"71d9d0ac9660c5d9566e5ab5e631d200c9c4386846056f44f7f8fe5d6251c972"}
Sep 06 01:45:05.964660 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.964602    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:05.984319 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:05.984255    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc" podStartSLOduration=0.984233515 podStartE2EDuration="984.233515ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 01:45:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 01:45:05.982901035 +0000 UTC m=+2174.308321016" watchObservedRunningTime="2026-09-06 01:45:05.984233515 +0000 UTC m=+2174.309653493"
Sep 06 01:45:06.899971 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:06.899938    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-lvh7b_6cac5cf6-00a3-4393-ad08-a1a776defc04/volume-data-source-validator/0.log"
Sep 06 01:45:07.983430 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:07.983405    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wxkt_87019f13-effe-48c5-8cc0-f424391f4798/dns/0.log"
Sep 06 01:45:08.022564 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:08.022531    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wxkt_87019f13-effe-48c5-8cc0-f424391f4798/kube-rbac-proxy/0.log"
Sep 06 01:45:08.253948 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:08.253871    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-58rzj_807d79e3-0a4f-4f9a-b15c-8732a0dc08fe/dns-node-resolver/0.log"
Sep 06 01:45:09.104894 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:09.104850    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fllzt_1db28da3-52e9-4c48-ac0b-69c584f20b36/node-ca/0.log"
Sep 06 01:45:10.698379 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:10.698347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-qdqkj_7718d843-9942-4be0-99f8-544b0fb4f4bb/kube-auth-proxy/0.log"
Sep 06 01:45:10.902682 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:10.902646    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8n29j_b1ae75ab-d8f3-493b-92a4-c47e94955f41/payload-pre-processing/0.log"
Sep 06 01:45:11.115010 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:11.114929    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f886f478-psnfb_dba8747c-e652-4685-804a-276d52281982/router/0.log"
Sep 06 01:45:11.986738 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:11.986695    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-44kv5/perf-node-gather-daemonset-8kkfc"
Sep 06 01:45:12.257833 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:12.257763    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v29hk_e8574ac9-345d-4c0b-9dd1-2c63a36563b0/serve-healthcheck-canary/0.log"
Sep 06 01:45:12.869520 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:12.869478    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-vccww_6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10/insights-operator/0.log"
Sep 06 01:45:12.869737 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:12.869720    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-vccww_6b69ed93-1b38-4d10-b62b-ba1cdd4a1a10/insights-operator/1.log"
Sep 06 01:45:13.088375 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:13.088341    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmw75_96c0717b-654b-4af2-9bfd-857f473cf2be/kube-rbac-proxy/0.log"
Sep 06 01:45:13.119354 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:13.119317    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmw75_96c0717b-654b-4af2-9bfd-857f473cf2be/exporter/0.log"
Sep 06 01:45:13.147714 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:13.147640    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pmw75_96c0717b-654b-4af2-9bfd-857f473cf2be/extractor/0.log"
Sep 06 01:45:15.705549 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:15.705521    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7v55k_5e7be1c6-5c0a-4e9e-bb5a-2bb41613cc8d/manager/0.log"
Sep 06 01:45:15.875633 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:15.875606    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-qdqkj_7718d843-9942-4be0-99f8-544b0fb4f4bb/kube-auth-proxy/0.log"
Sep 06 01:45:15.943316 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:15.943287    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6d8ddb49f9-7qpcf_624bd961-3f05-4053-8189-ef30efd3ee5b/manager/0.log"
Sep 06 01:45:15.980194 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:15.980092    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8n29j_b1ae75ab-d8f3-493b-92a4-c47e94955f41/payload-pre-processing/0.log"
Sep 06 01:45:16.010599 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:16.010568    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ssf42_dfbfddf0-54eb-4c1d-87fc-2363746d7185/server/0.log"
Sep 06 01:45:16.051911 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:16.051884    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f886f478-psnfb_dba8747c-e652-4685-804a-276d52281982/router/0.log"
Sep 06 01:45:16.144678 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:16.144635    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-t9ck5_927f0119-f6f4-4102-a28f-f0d2ad79f5b7/manager/0.log"
Sep 06 01:45:16.167898 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:16.167871    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bb49d79fd-t9ck5_927f0119-f6f4-4102-a28f-f0d2ad79f5b7/copy-manifests/0.log"
Sep 06 01:45:17.884351 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:17.884310    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfcd8dfd7-qdqkj_7718d843-9942-4be0-99f8-544b0fb4f4bb/kube-auth-proxy/0.log"
Sep 06 01:45:17.979939 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:17.979912    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-8n29j_b1ae75ab-d8f3-493b-92a4-c47e94955f41/payload-pre-processing/0.log"
Sep 06 01:45:18.067698 ip-10-0-132-189 kubenswrapper[2557]: I0906 01:45:18.067674    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f886f478-psnfb_dba8747c-e652-4685-804a-276d52281982/router/0.log"